Sep 09 16:39:13 devstack cinder-volume[76543]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 16:39:13 devstack cinder-volume[76543]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 16:39:13 devstack cinder-volume[76543]: we strongly recommend against using it for new projects. Sep 09 16:39:13 devstack cinder-volume[76543]: If you are already using Eventlet, we recommend migrating to a different Sep 09 16:39:13 devstack cinder-volume[76543]: framework. For more detail see Sep 09 16:39:13 devstack cinder-volume[76543]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 16:39:13 devstack cinder-volume[76543]: import eventlet # noqa Sep 09 16:39:15 devstack cinder-volume[76543]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 16:39:15 devstack cinder-volume[76543]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 16:39:15 devstack cinder-volume[76543]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 16:39:17 devstack cinder-volume[76543]: INFO dbcounter [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Registered counter for database cinder Sep 09 16:39:17 devstack cinder-volume[76543]: DEBUG oslo_db.sqlalchemy.engines [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:39:17 devstack cinder-volume[76543]: DEBUG dbcounter [-] [76543] Writer thread running {{(pid=76543) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 16:39:17 devstack cinder-volume[76543]: INFO cinder.rpc [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 16:39:17 devstack cinder-volume[76543]: INFO cinder.rpc [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 16:39:17 devstack cinder-volume[76543]: DEBUG oslo_db.sqlalchemy.engines [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:39:17 devstack cinder-volume[76543]: INFO cinder.volume.manager [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Determined volume DB was empty at startup. Sep 09 16:39:17 devstack cinder-volume[76543]: DEBUG cinder.volume.manager [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76543) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 16:39:17 devstack cinder-volume[76543]: INFO cinder.volume.manager [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 09 16:39:17 devstack cinder-volume[76543]: WARNING stevedore.named [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 16:39:17 devstack cinder-volume[76543]: WARNING castellan.key_manager [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 16:39:17 devstack cinder-volume[76543]: WARNING cinder.keymgr.conf_key_mgr [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 16:39:17 devstack cinder-volume[76543]: DEBUG cinder.volume.drivers.lvm [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76543) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 09 16:39:17 devstack cinder-volume[76543]: DEBUG oslo_concurrency.processutils [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_concurrency.processutils [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] CMD "cinder-rtstool verify" returned: 0 in 0.486s {{(pid=76543) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_db.sqlalchemy.engines [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:39:18 devstack cinder-volume[76543]: INFO cinder.rpc [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 09 16:39:18 devstack cinder-volume[76543]: INFO cinder.rpc [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 09 16:39:18 devstack cinder-volume[76543]: WARNING stevedore.named [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 16:39:18 devstack cinder-volume[76543]: WARNING castellan.key_manager [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 16:39:18 devstack cinder-volume[76543]: INFO cinder.volume.manager [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_db.sqlalchemy.engines [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76543) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:39:18 devstack cinder-volume[76543]: INFO oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Starting 1 workers Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Started child 76857 {{(pid=76543) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Full set of CONF: {{(pid=76543) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] ******************************************************************************** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Configuration options gathered from: {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] ================================================================================ {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] allow_availability_zone_fallback = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] allow_compression_on_image_upload = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] allowed_direct_url_schemes = [] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76857]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] api_rate_limit = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] auth_strategy = keystone {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] az_cache_duration = 3600 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_availability_zone = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_host = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_name = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_stats_polling_interval = 60 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backup_api_class = cinder.backup.api.API {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backup_name_template = backup-%s {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backup_use_same_host = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backup_use_temp_snapshot = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] chap_password = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] chap_username = {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cinder_internal_tenant_project_id = 7cdeb79670b649a9aa4cf8c7172b4dc8 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cinder_internal_tenant_user_id = 02ba72f224cc428d80f4bac4adf15efe {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cloned_volume_same_az = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cluster = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] compression_format = gzip {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] compute_api_class = cinder.compute.nova.API {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] config_dir = [] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] config_source = [] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] control_exchange = openstack {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] debug = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] default_availability_zone = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] default_group_type = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] default_volume_type = lvmdriver-1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] disk_geometry = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] driver_client_cert = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] driver_client_cert_key = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] driver_data_namespace = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] driver_ssl_cert_path = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] driver_ssl_cert_verify = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] driver_use_ssl = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] enable_force_upload = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] enable_new_services = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] enable_unsupported_driver = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] enabled_backends = ['lvmdriver-1'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] enforce_multipath_for_image_xfer = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] filter_function = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance_api_insecure = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance_api_ssl_compression = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance_ca_certificates_file = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance_catalog_info = image:glance:publicURL {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance_certfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance_keyfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance_num_retries = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance_request_timeout = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] goodness_function = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] graceful_shutdown_timeout = 5 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] group_api_class = cinder.group.api.API {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] host = devstack {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] image_compress_on_upload = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] image_conversion_address_space_limit = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] image_conversion_cpu_limit = 60 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] image_conversion_disable = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] image_upload_use_cinder_backend = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] image_upload_use_internal_tenant = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] image_volume_cache_enabled = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] image_volume_cache_max_count = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] image_volume_cache_max_size_gb = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] init_host_max_objects_retrieval = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] instance_format = [instance: %(uuid)s] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] iscsi_target_flags = {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] iscsi_write_cache = on {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] iser_helper = tgtadm {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76857]: INFO cinder.volume.manager [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] iser_ip_address = 192.168.122.110 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] iser_port = 3260 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] log_color = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] log_config_append = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] log_dir = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] log_file = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] log_options = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] log_rotate_interval = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] log_rotate_interval_type = days {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] log_rotation_type = none {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] max_age = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] max_logfile_count = 30 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] max_logfile_size_mb = 200 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] max_over_subscription_ratio = 20.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] message_reap_interval = 86400 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] message_ttl = 2592000 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] migration_create_volume_timeout_secs = 300 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] monkey_patch = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] monkey_patch_modules = [] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] my_ip = 192.168.122.110 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] no_snapshot_gb_quota = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] num_iser_scan_tries = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] num_shell_tries = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] num_volume_device_scan_tries = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] nvmeof_conn_info_version = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] nvmet_ns_id = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] nvmet_port_id = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] osapi_max_limit = 1000 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] osapi_volume_ext_list = [] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] osapi_volume_listen = 0.0.0.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] osapi_volume_listen_port = 8776 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] osapi_volume_use_ssl = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] osapi_volume_workers = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] per_volume_size_limit = -1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] periodic_fuzzy_delay = 60 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] periodic_interval = 60 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] project_id_regex = [0-9a-f\-]+ {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] public_endpoint = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] publish_errors = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] quota_backup_gigabytes = 1000 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] quota_backups = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] quota_gigabytes = 1000 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] quota_groups = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] quota_snapshots = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] quota_volumes = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] rate_limit_burst = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] rate_limit_except_level = CRITICAL {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] rate_limit_interval = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] reinit_driver_count = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] replication_device = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] report_discard_supported = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] report_interval = 120 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] reservation_clean_interval = 86400 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] reservation_expire = 86400 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] reserved_image_namespaces = [] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] reserved_percentage = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] rpc_response_timeout = 120 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] run_external_periodic_tasks = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] scst_target_driver = iscsi {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] scst_target_iqn_name = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_down_time = 720 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] shell_completion = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] snapshot_name_template = snapshot-%s {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] snapshot_same_host = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] split_loggers = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] state_path = /opt/stack/data/cinder {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] storage_availability_zone = nova {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] storage_protocol = iSCSI {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] syslog_log_facility = LOG_USER {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] target_helper = lioadm {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] target_ip_address = 192.168.122.110 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] target_port = 3260 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] target_protocol = iscsi {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] target_secondary_ip_addresses = [] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] trace_flags = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] transfer_api_class = cinder.transfer.api.API {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] transport_url = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] until_refresh = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] use_chap_auth = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] use_default_quota_class = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] use_journal = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] use_json = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] use_multipath_for_image_xfer = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] use_stderr = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] use_syslog = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] verify_glance_signatures = enabled {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_api_class = cinder.volume.api.API {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_backend_name = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_clear = zero {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_clear_ionice = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_clear_size = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_copy_bps_limit = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_dd_blocksize = 1M {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_name_template = volume-%s {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_service_inithost_offload = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volume_usage_audit_period = month {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] zoning_mode = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_concurrency.disable_process_locking = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.auth_section = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.auth_type = password {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.auth_version = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.cache = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.certfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.delay_auth_decision = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.http_connect_timeout = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.include_service_catalog = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.insecure = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.interface = public {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.keyfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_password = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcache_username = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.region_name = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.service_token_roles_required = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.service_type = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.token_cache_time = 300 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.backend = dogpile.cache.null {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.backend_argument = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.backend_expiration_time = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.config_prefix = cache.oslo {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.debug_cache_backend = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.enable_retry_client = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.enable_socket_keepalive = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.enabled = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.expiration_time = 600 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.hashclient_retry_attempts = 2 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.memcache_dead_retry = 300 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.memcache_pool_maxsize = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.memcache_sasl_enabled = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.password = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.proxies = [] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.redis_db = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.redis_sentinel_service_name = mymaster {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.redis_server = localhost:6379 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.retry_attempts = 2 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.retry_delay = 0.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.socket_keepalive_count = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.socket_keepalive_idle = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.socket_keepalive_interval = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.socket_timeout = 1.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.tls_allowed_ciphers = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.tls_cafile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.tls_certfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.tls_enabled = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.tls_keyfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cache.username = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] coordination.backend_url = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.asyncio_connection = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.asyncio_slave_connection = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.backend = sqlalchemy {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.connection = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.connection_debug = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.connection_parameters = {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.connection_recycle_time = 3600 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.connection_trace = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.db_inc_retry_interval = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.db_max_retries = 20 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.db_max_retry_interval = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.db_retry_interval = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.max_overflow = 50 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.max_pool_size = 5 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.max_retries = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.mysql_wsrep_sync_wait = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.pool_timeout = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.retry_interval = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:18 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.slave_connection = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.sqlite_synchronous = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.synchronous_reader = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] database.use_db_reconnect = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_tracing.insecure = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.connection_string = messaging:// {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.enabled = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.es_doc_type = notification {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.es_scroll_size = 10000 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.es_scroll_time = 2m {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.filter_error_trace = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.hmac_keys = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.sentinel_service_name = mymaster {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.socket_timeout = 0.1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.trace_requests = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler.trace_sqlalchemy = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler_jaeger.process_tags = {} {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler_jaeger.service_name_prefix = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] profiler_otlp.service_name_prefix = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_policy.enforce_new_defaults = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_policy.policy_default_rule = default {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_policy.policy_file = policy.yaml {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_policy.remote_timeout = 60.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] privsep_osbrick.group = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] privsep_osbrick.helper_command = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] privsep_osbrick.user = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cinder_sys_admin.group = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cinder_sys_admin.helper_command = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] cinder_sys_admin.user = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.auth_section = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.auth_type = password {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.cafile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.certfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.collect_timing = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.insecure = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.keyfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.send_service_user_token = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.split_loggers = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.timeout = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.tls_ciphers = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] service_user.tls_min_version = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.auth_section = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.auth_type = password {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.certfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.collect_timing = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.insecure = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.keyfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.region_name = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.split_loggers = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.timeout = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.tls_ciphers = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] glance.tls_min_version = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.backend_availability_zone = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.chap_password = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.chap_username = {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.disk_geometry = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.driver_client_cert = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.driver_client_cert_key = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.driver_data_namespace = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack sudo[76897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.driver_use_ssl = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.enable_unsupported_driver = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.extra_capabilities = {} {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.filter_function = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.goodness_function = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack sudo[76897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.iscsi_target_flags = {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.iscsi_write_cache = on {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.iser_helper = tgtadm {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.iser_port = 3260 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.lvm_mirrors = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.lvm_share_target = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.lvm_type = auto {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.num_shell_tries = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.nvmet_port_id = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.replication_device = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.report_discard_supported = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.reserved_percentage = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.scst_target_driver = iscsi {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.scst_target_iqn_name = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.storage_protocol = iSCSI {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.target_helper = tgtadm {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.target_port = 3260 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.target_protocol = iscsi {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.trace_flags = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.unique_fqdn_network = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.use_chap_auth = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.volume_backend_name = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.volume_clear = zero {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.volume_clear_ionice = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.volume_clear_size = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.volume_group = cinder-volumes {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_reports.file_event_handler = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_reports.log_dir = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.backend_availability_zone = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.backend_host = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.chap_password = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.chap_username = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.chiscsi_conf = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.disk_geometry = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.driver_client_cert = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.driver_data_namespace = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.driver_use_ssl = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.extra_capabilities = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.filter_function = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.goodness_function = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.iser_helper = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.iser_ip_address = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.iser_port = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.iser_target_prefix = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.lvm_conf_file = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.lvm_mirrors = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.lvm_share_target = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.lvm_type = auto {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.num_shell_tries = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.nvmet_port_id = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.replication_device = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.report_discard_supported = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.reserved_percentage = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.scst_target_driver = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.storage_protocol = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.target_helper = lioadm {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.target_ip_address = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.target_port = 3260 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.target_protocol = iscsi {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.trace_flags = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.use_chap_auth = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.volume_clear = zero {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.volume_clear_size = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] lvmdriver-1.volumes_dir = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.ssl = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.ssl_version = {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_notifications.driver = [] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_notifications.retry = -1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] oslo_messaging_notifications.transport_url = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] key_manager.fixed_key = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.barbican_api_version = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.barbican_endpoint = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.barbican_endpoint_type = public {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.barbican_region_name = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.cafile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.certfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.collect_timing = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.insecure = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.keyfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.number_of_retries = 60 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.retry_delay = 1 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.send_service_user_token = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.split_loggers = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.timeout = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.tls_ciphers = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.tls_min_version = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.verify_ssl = True {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican.verify_ssl_path = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.auth_section = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.auth_type = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.cafile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.certfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.collect_timing = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.insecure = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.keyfile = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.split_loggers = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.timeout = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.tls_ciphers = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] barbican_service_user.tls_min_version = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.approle_role_id = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.approle_secret_id = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.auth_method = approle {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.auth_path = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.kv_mountpoint = secret {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.kv_path = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.kv_version = 2 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.namespace = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.root_token_id = **** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.ssl_ca_crt_file = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.timeout = 60.0 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.token_file = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.token_role = None {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.use_ssl = False {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:39:18 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] ******************************************************************************** {{(pid=76543) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 16:39:18 devstack sudo[76897]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:18 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:18 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:18 devstack sudo[76960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:39:18 devstack sudo[76960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:19 devstack sudo[76960]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:19 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.293s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:19 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:39:19 devstack cinder-volume[76857]: INFO cinder.brick.local_dev.lvm [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 09 16:39:19 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:19 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:19 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:19 devstack sudo[77040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 16:39:19 devstack sudo[77040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:19 devstack sudo[77040]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:19 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:19 devstack cinder-volume[76857]: DEBUG cinder.brick.local_dev.lvm [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76857) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 09 16:39:19 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:19 devstack sudo[77130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:39:19 devstack sudo[77130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:21 devstack sudo[77130]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.583s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:21 devstack sudo[77411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:39:21 devstack sudo[77411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:21 devstack sudo[77411]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.276s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:21 devstack sudo[77485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 09 16:39:21 devstack sudo[77485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:21 devstack sudo[77485]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.265s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:21 devstack sudo[77488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 16:39:21 devstack sudo[77488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:21 devstack sudo[77488]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.312s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:21 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:21 devstack sudo[77491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 16:39:21 devstack sudo[77491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:22 devstack sudo[77491]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:22 devstack sudo[77500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:39:22 devstack sudo[77500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:22 devstack sudo[77500]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:22 devstack sudo[77504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:39:22 devstack sudo[77504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:22 devstack sudo[77504]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:22 devstack sudo[77508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:39:22 devstack sudo[77508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:23 devstack sudo[77508]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.257s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:23 devstack cinder-volume[76857]: INFO cinder.volume.drivers.lvm [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:23 devstack sudo[77512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:39:23 devstack sudo[77512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:23 devstack sudo[77512]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG cinder.volume.drivers.lvm [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Updating volume stats {{(pid=76857) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:23 devstack sudo[77515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 16:39:23 devstack sudo[77515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:23 devstack sudo[77515]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:23 devstack sudo[77520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:39:23 devstack sudo[77520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:23 devstack sudo[77520]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:23 devstack sudo[77523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:39:23 devstack sudo[77523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:24 devstack sudo[77523]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:24 devstack sudo[77526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:39:24 devstack sudo[77526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:24 devstack sudo[77526]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:24 devstack cinder-volume[76857]: INFO cinder.volume.driver [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Driver hasn't implemented _init_vendor_properties() Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG cinder.volume.driver [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76857) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG oslo_db.sqlalchemy.engines [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76857) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG dbcounter [-] [76857] Writer thread running {{(pid=76857) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG cinder.db.api [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Building query based on filter {{(pid=76857) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG cinder.image.image_utils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76857) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 16:39:24 devstack cinder-volume[76857]: INFO cinder.keymgr.migration [None req-c0fe0a13-7c65-49f0-8dfb-073ad843248d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG cinder.volume.drivers.lvm [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Updating volume stats {{(pid=76857) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:24 devstack sudo[77533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 16:39:24 devstack sudo[77533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:24 devstack sudo[77533]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:24 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:24 devstack sudo[77536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:39:24 devstack sudo[77536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:25 devstack sudo[77536]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:25 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:25 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:25 devstack sudo[77539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:39:25 devstack sudo[77539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:25 devstack sudo[77539]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:25 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.280s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:25 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:25 devstack sudo[77546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:39:25 devstack sudo[77546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:25 devstack sudo[77546]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:25 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:25 devstack cinder-volume[76857]: DEBUG cinder.manager [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Notifying Schedulers of capabilities ... {{(pid=76857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:39:25 devstack cinder-volume[76857]: INFO cinder.volume.manager [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Driver initialization completed successfully. Sep 09 16:39:25 devstack cinder-volume[76857]: INFO cinder.manager [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Initiating service 2 cleanup Sep 09 16:39:25 devstack cinder-volume[76857]: INFO cinder.manager [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Service 2 cleanup completed. Sep 09 16:39:25 devstack cinder-volume[76857]: DEBUG cinder.service [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Creating RPC server for service cinder-volume {{(pid=76857) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 16:39:25 devstack cinder-volume[76857]: DEBUG cinder.service [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76857) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 16:39:25 devstack cinder-volume[76857]: INFO cinder.volume.manager [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 09 16:39:25 devstack cinder-volume[76857]: DEBUG cinder.volume.drivers.lvm [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Updating volume stats {{(pid=76857) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 16:39:25 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:25 devstack sudo[77549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 16:39:25 devstack sudo[77549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:26 devstack sudo[77549]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:26 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:26 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:26 devstack sudo[77552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:39:26 devstack sudo[77552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:26 devstack sudo[77552]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:26 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:26 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:26 devstack sudo[77559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:39:26 devstack sudo[77559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:26 devstack sudo[77559]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:26 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:26 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:39:26 devstack sudo[77564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:39:26 devstack sudo[77564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:39:27 devstack sudo[77564]: pam_unix(sudo:session): session closed for user root Sep 09 16:39:27 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.367s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:39:27 devstack cinder-volume[76857]: INFO cinder.volume.manager [None req-a769ae4d-01f4-46b6-801e-e5a4fb595c12 None None] Driver post RPC initialization completed successfully. Sep 09 16:39:28 devstack cinder-volume[76543]: DEBUG dbcounter [-] [76543] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76543) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:39:35 devstack cinder-volume[76857]: DEBUG dbcounter [-] [76857] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76857) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:39:37 devstack cinder-volume[76857]: DEBUG dbcounter [-] [76857] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=76857) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:40:22 devstack cinder-volume[76857]: DEBUG oslo_service.periodic_task [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76857) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:40:22 devstack cinder-volume[76857]: DEBUG cinder.volume.drivers.lvm [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Updating volume stats {{(pid=76857) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 16:40:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:40:22 devstack sudo[79534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 16:40:22 devstack sudo[79534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:40:22 devstack sudo[79534]: pam_unix(sudo:session): session closed for user root Sep 09 16:40:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:40:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:40:22 devstack sudo[79537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:40:22 devstack sudo[79537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:40:22 devstack sudo[79537]: pam_unix(sudo:session): session closed for user root Sep 09 16:40:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:40:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:40:22 devstack sudo[79540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:40:22 devstack sudo[79540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:40:22 devstack sudo[79540]: pam_unix(sudo:session): session closed for user root Sep 09 16:40:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:40:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:40:22 devstack sudo[79543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:40:22 devstack sudo[79543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:40:23 devstack sudo[79543]: pam_unix(sudo:session): session closed for user root Sep 09 16:40:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:40:23 devstack cinder-volume[76857]: DEBUG cinder.manager [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Notifying Schedulers of capabilities ... {{(pid=76857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:40:23 devstack cinder-volume[76857]: DEBUG oslo_service.periodic_task [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running periodic task VolumeManager._thread_info {{(pid=76857) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:40:23 devstack cinder-volume[76857]: DEBUG cinder.volume.manager [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] thread count: 6 {{(pid=76857) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:40:23 devstack cinder-volume[76857]: DEBUG cinder.volume.manager [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] thread info: [<_MainThread(MainThread, started 133399712153728)>, , , , , ] {{(pid=76857) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:41:22 devstack cinder-volume[76857]: DEBUG oslo_service.periodic_task [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76857) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:41:22 devstack cinder-volume[76857]: DEBUG cinder.volume.drivers.lvm [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Updating volume stats {{(pid=76857) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 16:41:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:41:22 devstack sudo[82839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 16:41:22 devstack sudo[82839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:41:22 devstack sudo[82839]: pam_unix(sudo:session): session closed for user root Sep 09 16:41:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:41:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:41:22 devstack sudo[82846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:41:22 devstack sudo[82846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:41:22 devstack sudo[82846]: pam_unix(sudo:session): session closed for user root Sep 09 16:41:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:41:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:41:22 devstack sudo[82850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:41:22 devstack sudo[82850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:41:22 devstack sudo[82850]: pam_unix(sudo:session): session closed for user root Sep 09 16:41:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:41:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:41:22 devstack sudo[82857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:41:22 devstack sudo[82857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:41:23 devstack sudo[82857]: pam_unix(sudo:session): session closed for user root Sep 09 16:41:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:41:23 devstack cinder-volume[76857]: DEBUG cinder.manager [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Notifying Schedulers of capabilities ... {{(pid=76857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:41:37 devstack cinder-volume[76857]: DEBUG dbcounter [-] [76857] Writing DB stats cinder:SELECT=1 {{(pid=76857) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:41:37 devstack cinder-volume[76857]: DEBUG dbcounter [-] [76857] Writing DB stats cinder:UPDATE=1 {{(pid=76857) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:42:22 devstack cinder-volume[76857]: DEBUG oslo_service.periodic_task [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76857) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:42:22 devstack cinder-volume[76857]: DEBUG cinder.volume.drivers.lvm [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Updating volume stats {{(pid=76857) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 16:42:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:42:22 devstack sudo[84814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 16:42:22 devstack sudo[84814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:42:22 devstack sudo[84814]: pam_unix(sudo:session): session closed for user root Sep 09 16:42:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.301s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:42:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:42:22 devstack sudo[84817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:42:22 devstack sudo[84817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:42:22 devstack sudo[84817]: pam_unix(sudo:session): session closed for user root Sep 09 16:42:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:42:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:42:22 devstack sudo[84840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:42:22 devstack sudo[84840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:42:23 devstack sudo[84840]: pam_unix(sudo:session): session closed for user root Sep 09 16:42:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:42:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:42:23 devstack sudo[84844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:42:23 devstack sudo[84844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:42:23 devstack sudo[84844]: pam_unix(sudo:session): session closed for user root Sep 09 16:42:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:42:23 devstack cinder-volume[76857]: DEBUG cinder.manager [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Notifying Schedulers of capabilities ... {{(pid=76857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:42:23 devstack cinder-volume[76857]: DEBUG oslo_service.periodic_task [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running periodic task VolumeManager._thread_info {{(pid=76857) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:42:23 devstack cinder-volume[76857]: DEBUG cinder.volume.manager [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] thread count: 6 {{(pid=76857) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:42:23 devstack cinder-volume[76857]: DEBUG cinder.volume.manager [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] thread info: [<_MainThread(MainThread, started 133399712153728)>, , , , , ] {{(pid=76857) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:43:22 devstack cinder-volume[76857]: DEBUG oslo_service.periodic_task [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76857) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:43:22 devstack cinder-volume[76857]: DEBUG cinder.volume.drivers.lvm [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Updating volume stats {{(pid=76857) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 09 16:43:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:43:22 devstack sudo[86080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 09 16:43:22 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:43:22 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root Sep 09 16:43:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:43:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:43:22 devstack sudo[86083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:43:22 devstack sudo[86083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:43:22 devstack sudo[86083]: pam_unix(sudo:session): session closed for user root Sep 09 16:43:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:43:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:43:22 devstack sudo[86086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 09 16:43:22 devstack sudo[86086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:43:22 devstack sudo[86086]: pam_unix(sudo:session): session closed for user root Sep 09 16:43:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:43:22 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:43:22 devstack sudo[86089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 09 16:43:22 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:43:23 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root Sep 09 16:43:23 devstack cinder-volume[76857]: DEBUG oslo_concurrency.processutils [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76857) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:43:23 devstack cinder-volume[76857]: DEBUG cinder.manager [None req-dbb60a85-e002-4d6a-910b-0567c6f66498 None None] Notifying Schedulers of capabilities ... {{(pid=76857) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:43:37 devstack cinder-volume[76857]: DEBUG dbcounter [-] [76857] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76857) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:43:45 devstack cinder-volume[76543]: INFO oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Caught SIGTERM, stopping children Sep 09 16:43:45 devstack cinder-volume[76543]: DEBUG oslo_concurrency.lockutils [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Acquiring lock "singleton_lock" {{(pid=76543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 16:43:45 devstack cinder-volume[76543]: DEBUG oslo_concurrency.lockutils [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Acquired lock "singleton_lock" {{(pid=76543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 16:43:45 devstack cinder-volume[76543]: DEBUG oslo_concurrency.lockutils [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Releasing lock "singleton_lock" {{(pid=76543) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 16:43:45 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Stop services. {{(pid=76543) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 09 16:43:45 devstack cinder-volume[76543]: DEBUG oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Killing children. {{(pid=76543) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 09 16:43:45 devstack cinder-volume[76543]: INFO oslo_service.backend._eventlet.service [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Waiting on 1 children to exit Sep 09 16:43:50 devstack cinder-volume[76857]: DEBUG oslo_concurrency.lockutils [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Acquiring lock "singleton_lock" {{(pid=76857) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 16:43:50 devstack cinder-volume[76857]: DEBUG oslo_concurrency.lockutils [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Acquired lock "singleton_lock" {{(pid=76857) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 16:43:50 devstack cinder-volume[76857]: DEBUG oslo_concurrency.lockutils [None req-91866aba-0641-42fa-85f0-4c0fe8286c7f None None] Releasing lock "singleton_lock" {{(pid=76857) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 16:43:50 devstack cinder-volume[76857]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 09 16:43:51 devstack cinder-volume[86696]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 16:43:51 devstack cinder-volume[86696]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 16:43:51 devstack cinder-volume[86696]: we strongly recommend against using it for new projects. Sep 09 16:43:51 devstack cinder-volume[86696]: If you are already using Eventlet, we recommend migrating to a different Sep 09 16:43:51 devstack cinder-volume[86696]: framework. For more detail see Sep 09 16:43:51 devstack cinder-volume[86696]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 16:43:51 devstack cinder-volume[86696]: import eventlet # noqa Sep 09 16:43:53 devstack cinder-volume[86696]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 16:43:53 devstack cinder-volume[86696]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 16:43:53 devstack cinder-volume[86696]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 16:43:53 devstack cinder-volume[86696]: INFO dbcounter [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Registered counter for database cinder Sep 09 16:43:53 devstack cinder-volume[86696]: DEBUG oslo_db.sqlalchemy.engines [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86696) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG dbcounter [-] [86696] Writer thread running {{(pid=86696) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 16:43:54 devstack cinder-volume[86696]: INFO cinder.rpc [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 16:43:54 devstack cinder-volume[86696]: INFO cinder.rpc [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_db.sqlalchemy.engines [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86696) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:43:54 devstack cinder-volume[86696]: INFO cinder.volume.manager [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Determined volume DB was empty at startup. Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG cinder.volume.manager [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86696) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 16:43:54 devstack cinder-volume[86696]: INFO cinder.volume.manager [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 09 16:43:54 devstack cinder-volume[86696]: WARNING stevedore.named [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 16:43:54 devstack cinder-volume[86696]: WARNING castellan.key_manager [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 16:43:54 devstack cinder-volume[86696]: WARNING cinder.keymgr.conf_key_mgr [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 16:43:54 devstack cinder-volume[86696]: INFO cinder.volume.manager [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_db.sqlalchemy.engines [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86696) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:43:54 devstack cinder-volume[86696]: INFO oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Starting 1 workers Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Started child 86919 {{(pid=86696) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Full set of CONF: {{(pid=86696) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] ******************************************************************************** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Configuration options gathered from: {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] ================================================================================ {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] allow_availability_zone_fallback = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] allow_compression_on_image_upload = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] allowed_direct_url_schemes = [] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] api_rate_limit = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] auth_strategy = keystone {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_availability_zone = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_host = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_name = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_stats_polling_interval = 60 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backup_api_class = cinder.backup.api.API {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backup_name_template = backup-%s {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86919]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backup_use_same_host = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backup_use_temp_snapshot = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] chap_password = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] chap_username = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cinder_internal_tenant_project_id = 7cdeb79670b649a9aa4cf8c7172b4dc8 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cinder_internal_tenant_user_id = 02ba72f224cc428d80f4bac4adf15efe {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cluster = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] compression_format = gzip {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] compute_api_class = cinder.compute.nova.API {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] config_dir = [] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] config_source = [] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] control_exchange = openstack {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] debug = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] default_availability_zone = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] default_group_type = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] default_volume_type = QuobyteHD {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] disk_geometry = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] driver_client_cert = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] driver_client_cert_key = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] driver_data_namespace = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] driver_ssl_cert_path = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] driver_ssl_cert_verify = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] driver_use_ssl = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] enable_new_services = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] enable_unsupported_driver = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] enabled_backends = ['QuobyteHD'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] enforce_multipath_for_image_xfer = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] filter_function = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance_api_insecure = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance_api_ssl_compression = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance_ca_certificates_file = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance_catalog_info = image:glance:publicURL {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance_certfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance_keyfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance_num_retries = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance_request_timeout = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] goodness_function = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] graceful_shutdown_timeout = 5 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] group_api_class = cinder.group.api.API {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] host = devstack {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] image_compress_on_upload = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] image_conversion_address_space_limit = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] image_conversion_cpu_limit = 60 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] image_conversion_disable = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] image_upload_use_cinder_backend = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] image_upload_use_internal_tenant = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] image_volume_cache_enabled = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] image_volume_cache_max_count = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] image_volume_cache_max_size_gb = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] init_host_max_objects_retrieval = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] instance_format = [instance: %(uuid)s] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] iscsi_target_flags = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] iscsi_write_cache = on {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] iser_helper = tgtadm {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] iser_ip_address = 192.168.122.110 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] iser_port = 3260 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] log_color = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] log_config_append = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] log_dir = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] log_file = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] log_options = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] log_rotate_interval = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] log_rotate_interval_type = days {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] log_rotation_type = none {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] max_age = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] max_logfile_count = 30 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] max_logfile_size_mb = 200 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] max_over_subscription_ratio = 20.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] message_reap_interval = 86400 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] message_ttl = 2592000 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] migration_create_volume_timeout_secs = 300 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] monkey_patch = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] monkey_patch_modules = [] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] my_ip = 192.168.122.110 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] no_snapshot_gb_quota = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] num_iser_scan_tries = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] num_shell_tries = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] num_volume_device_scan_tries = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] nvmeof_conn_info_version = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] nvmet_ns_id = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] nvmet_port_id = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] osapi_max_limit = 1000 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] osapi_volume_ext_list = [] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] osapi_volume_listen_port = 8776 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] osapi_volume_use_ssl = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] osapi_volume_workers = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] per_volume_size_limit = -1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] periodic_fuzzy_delay = 60 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] periodic_interval = 60 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86919]: INFO cinder.volume.manager [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 09 16:43:54 devstack cinder-volume[86919]: DEBUG cinder.volume.drivers.remotefs [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86919) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] public_endpoint = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] publish_errors = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] quota_backup_gigabytes = 1000 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] quota_backups = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] quota_gigabytes = 1000 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] quota_groups = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] quota_snapshots = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] quota_volumes = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] rate_limit_burst = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] rate_limit_except_level = CRITICAL {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] rate_limit_interval = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] reinit_driver_count = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] replication_device = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] report_discard_supported = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] report_interval = 120 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] reservation_clean_interval = 86400 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] reservation_expire = 86400 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] reserved_image_namespaces = [] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] reserved_percentage = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] rpc_response_timeout = 120 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] run_external_periodic_tasks = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] scst_target_driver = iscsi {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] scst_target_iqn_name = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_down_time = 720 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] shell_completion = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] snapshot_name_template = snapshot-%s {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] split_loggers = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] state_path = /opt/stack/data/cinder {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] storage_availability_zone = nova {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] storage_protocol = iSCSI {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] syslog_log_facility = LOG_USER {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] target_helper = lioadm {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] target_ip_address = 192.168.122.110 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] target_port = 3260 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] target_protocol = iscsi {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] target_secondary_ip_addresses = [] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] trace_flags = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] transport_url = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] until_refresh = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] use_chap_auth = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] use_default_quota_class = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] use_journal = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] use_json = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] use_multipath_for_image_xfer = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] use_stderr = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] use_syslog = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] verify_glance_signatures = enabled {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_api_class = cinder.volume.api.API {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_backend_name = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_clear = zero {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_clear_ionice = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_clear_size = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_copy_bps_limit = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_dd_blocksize = 1M {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_name_template = volume-%s {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_service_inithost_offload = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volume_usage_audit_period = month {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] zoning_mode = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_concurrency.disable_process_locking = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.auth_section = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.auth_type = password {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.auth_version = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.cache = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.certfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.include_service_catalog = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.insecure = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.interface = public {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.keyfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_password = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcache_username = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.region_name = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.service_type = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.backend = dogpile.cache.null {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.backend_argument = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.backend_expiration_time = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.config_prefix = cache.oslo {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.debug_cache_backend = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.enable_retry_client = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.enable_socket_keepalive = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.enabled = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.expiration_time = 600 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.hashclient_retry_attempts = 2 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.memcache_dead_retry = 300 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.memcache_pool_maxsize = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.memcache_sasl_enabled = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.password = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.proxies = [] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.redis_db = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.redis_server = localhost:6379 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.retry_attempts = 2 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.retry_delay = 0.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.socket_keepalive_count = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.socket_keepalive_idle = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.socket_keepalive_interval = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.socket_timeout = 1.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.tls_allowed_ciphers = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.tls_cafile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.tls_certfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.tls_enabled = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.tls_keyfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cache.username = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] coordination.backend_url = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.asyncio_connection = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.asyncio_slave_connection = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86919]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86919) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.backend = sqlalchemy {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.connection = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.connection_debug = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.connection_parameters = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.connection_recycle_time = 3600 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.connection_trace = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86919]: WARNING cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 09 16:43:54 devstack cinder-volume[86919]: WARNING cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.db_inc_retry_interval = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.db_max_retries = 20 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.db_max_retry_interval = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.db_retry_interval = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.max_overflow = 50 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86919]: DEBUG oslo_concurrency.processutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Running cmd (subprocess): mount.quobyte {{(pid=86919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.max_pool_size = 5 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.max_retries = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.mysql_wsrep_sync_wait = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.pool_timeout = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.retry_interval = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.slave_connection = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.sqlite_synchronous = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.synchronous_reader = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] database.use_db_reconnect = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_tracing.insecure = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.connection_string = messaging:// {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.enabled = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.es_doc_type = notification {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.es_scroll_size = 10000 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.es_scroll_time = 2m {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.filter_error_trace = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.hmac_keys = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.sentinel_service_name = mymaster {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.socket_timeout = 0.1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.trace_requests = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler.trace_sqlalchemy = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler_jaeger.process_tags = {} {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler_jaeger.service_name_prefix = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] profiler_otlp.service_name_prefix = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_policy.enforce_new_defaults = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_policy.policy_default_rule = default {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_policy.policy_file = policy.yaml {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] privsep_osbrick.group = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] privsep_osbrick.helper_command = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] privsep_osbrick.user = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cinder_sys_admin.group = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cinder_sys_admin.helper_command = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] cinder_sys_admin.user = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.auth_section = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.auth_type = password {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.cafile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.certfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.collect_timing = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.insecure = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.keyfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.send_service_user_token = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.split_loggers = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.timeout = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.tls_ciphers = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] service_user.tls_min_version = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.auth_section = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.auth_type = password {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.certfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.collect_timing = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.insecure = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.keyfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.region_name = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.split_loggers = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.timeout = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.tls_ciphers = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] glance.tls_min_version = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.backend_availability_zone = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.chap_password = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.chap_username = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.disk_geometry = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.driver_client_cert = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.driver_client_cert_key = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.driver_data_namespace = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.driver_use_ssl = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.extra_capabilities = {} {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.filter_function = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.goodness_function = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.iscsi_target_flags = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.iscsi_write_cache = on {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.iser_helper = tgtadm {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.iser_port = 3260 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nas_host = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nas_login = admin {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nas_mount_options = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nas_password = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nas_private_key = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nas_share_path = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.num_shell_tries = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.quobyte_volume_url = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.replication_device = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.report_discard_supported = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.reserved_percentage = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.target_helper = tgtadm {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.target_port = 3260 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.target_protocol = iscsi {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.trace_flags = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.unique_fqdn_network = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.use_chap_auth = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.volume_backend_name = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.volume_clear = zero {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.volume_clear_ionice = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.volume_clear_size = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_reports.file_event_handler = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_reports.log_dir = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.backend_availability_zone = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.backend_host = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.chap_password = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.chap_username = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.chiscsi_conf = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.disk_geometry = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.driver_client_cert = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack quobyte-client[86920]: Reading configuration file: /etc/quobyte/client.cfg Sep 09 16:43:54 devstack quobyte-client[86920]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.driver_data_namespace = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.driver_use_ssl = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.extra_capabilities = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.filter_function = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.goodness_function = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86919]: DEBUG oslo_concurrency.processutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] CMD "mount.quobyte" returned: 1 in 0.120s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:43:54 devstack cinder-volume[86919]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=86919) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.iser_helper = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.iser_ip_address = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.iser_port = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86919]: INFO cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e ... Sep 09 16:43:54 devstack cinder-volume[86919]: DEBUG oslo_concurrency.processutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 -c /etc/quobyte/client-cinder.cfg {{(pid=86919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.iser_target_prefix = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nas_host = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nas_login = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nas_mount_options = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nas_password = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nas_private_key = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nas_share_path = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nas_ssh_port = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.num_shell_tries = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.nvmet_port_id = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.replication_device = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.report_discard_supported = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.reserved_percentage = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.scst_target_driver = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.storage_protocol = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.target_helper = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.target_ip_address = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.target_port = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.target_prefix = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.target_protocol = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.trace_flags = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.use_chap_auth = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.volume_clear = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.volume_clear_size = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] QuobyteHD.volumes_dir = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 -c /etc/quobyte/client-cinder.cfg Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.ssl = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_notifications.driver = [] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_notifications.retry = -1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] key_manager.fixed_key = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.barbican_api_version = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.barbican_endpoint = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.barbican_endpoint_type = public {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.barbican_region_name = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.cafile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.certfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.collect_timing = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.insecure = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.keyfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.number_of_retries = 60 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.retry_delay = 1 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.send_service_user_token = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.split_loggers = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.timeout = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.tls_ciphers = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.tls_min_version = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.verify_ssl = True {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican.verify_ssl_path = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.auth_section = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.auth_type = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.cafile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.certfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.collect_timing = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.insecure = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.keyfile = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.split_loggers = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.timeout = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.tls_ciphers = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] barbican_service_user.tls_min_version = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.approle_role_id = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.approle_secret_id = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.auth_method = approle {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.auth_path = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.kv_mountpoint = secret {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.kv_path = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.kv_version = 2 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.namespace = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.root_token_id = **** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.ssl_ca_crt_file = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.timeout = 60.0 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.token_file = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.token_role = None {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.use_ssl = False {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:43:54 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] ******************************************************************************** {{(pid=86696) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 16:43:55 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG oslo_concurrency.processutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.412s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:43:55 devstack cinder-volume[86919]: INFO cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e succeeded Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=86919) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.429s {{(pid=86919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG oslo_concurrency.processutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:43:55 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:43:55 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:43:55 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG oslo_concurrency.processutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.245s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:43:55 devstack cinder-volume[86919]: INFO cinder.volume.driver [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Driver hasn't implemented _init_vendor_properties() Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG cinder.volume.driver [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3467407226562, 'free_capacity_gb': 1773.3467407226562, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86919) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG oslo_db.sqlalchemy.engines [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86919) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG dbcounter [-] [86919] Writer thread running {{(pid=86919) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG cinder.db.api [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Building query based on filter {{(pid=86919) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG cinder.image.image_utils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86919) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 16:43:55 devstack cinder-volume[86919]: INFO cinder.keymgr.migration [None req-7dbdb301-8f88-458f-b1f7-f18de077953d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=86919) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=86919) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG oslo_concurrency.processutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:43:55 devstack sudo[86997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:43:55 devstack sudo[86997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:43:55 devstack sudo[86997]: pam_unix(sudo:session): session closed for user root Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG oslo_concurrency.processutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.228s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG cinder.manager [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Notifying Schedulers of capabilities ... {{(pid=86919) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:43:55 devstack cinder-volume[86919]: INFO cinder.volume.manager [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Driver initialization completed successfully. Sep 09 16:43:55 devstack cinder-volume[86919]: INFO cinder.manager [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Initiating service 3 cleanup Sep 09 16:43:55 devstack cinder-volume[86919]: INFO cinder.manager [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Service 3 cleanup completed. Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG cinder.service [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Creating RPC server for service cinder-volume {{(pid=86919) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 16:43:55 devstack cinder-volume[86919]: DEBUG cinder.service [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86919) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 16:43:56 devstack cinder-volume[86919]: INFO cinder.volume.manager [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 09 16:43:56 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:43:56 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:43:56 devstack cinder-volume[86919]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=86919) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:43:56 devstack cinder-volume[86919]: DEBUG cinder.volume.drivers.quobyte [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=86919) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:43:56 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86919) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:43:56 devstack cinder-volume[86919]: DEBUG oslo_concurrency.processutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=86919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:43:56 devstack sudo[87000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:43:56 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:43:56 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root Sep 09 16:43:56 devstack cinder-volume[86919]: DEBUG oslo_concurrency.processutils [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.255s {{(pid=86919) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:43:56 devstack cinder-volume[86919]: INFO cinder.volume.manager [None req-ebfc2e6e-0093-4214-bf40-200a5d7b9af3 None None] Driver post RPC initialization completed successfully. Sep 09 16:44:00 devstack cinder-volume[86696]: INFO oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Caught SIGTERM, stopping children Sep 09 16:44:00 devstack cinder-volume[86696]: DEBUG oslo_concurrency.lockutils [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Acquiring lock "singleton_lock" {{(pid=86696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 16:44:00 devstack cinder-volume[86696]: DEBUG oslo_concurrency.lockutils [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Acquired lock "singleton_lock" {{(pid=86696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 16:44:00 devstack cinder-volume[86696]: DEBUG oslo_concurrency.lockutils [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Releasing lock "singleton_lock" {{(pid=86696) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 16:44:00 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Stop services. {{(pid=86696) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 09 16:44:00 devstack cinder-volume[86696]: DEBUG oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Killing children. {{(pid=86696) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 09 16:44:00 devstack cinder-volume[86696]: INFO oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Waiting on 1 children to exit Sep 09 16:44:04 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Acquiring lock "singleton_lock" {{(pid=86919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 16:44:04 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Acquired lock "singleton_lock" {{(pid=86919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 16:44:04 devstack cinder-volume[86919]: DEBUG oslo_concurrency.lockutils [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Releasing lock "singleton_lock" {{(pid=86919) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 16:44:04 devstack cinder-volume[86919]: WARNING amqp [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 16:44:04 devstack cinder-volume[86919]: WARNING amqp [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 09 16:44:04 devstack cinder-volume[86696]: INFO oslo_service.backend._eventlet.service [None req-55c17b40-24ae-465d-a126-c9cdb8d0fbd7 None None] Child 86919 exited with status 0 Sep 09 16:44:04 devstack cinder-volume[87207]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 09 16:44:04 devstack cinder-volume[87207]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 16:44:04 devstack cinder-volume[87207]: we strongly recommend against using it for new projects. Sep 09 16:44:04 devstack cinder-volume[87207]: If you are already using Eventlet, we recommend migrating to a different Sep 09 16:44:04 devstack cinder-volume[87207]: framework. For more detail see Sep 09 16:44:04 devstack cinder-volume[87207]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 16:44:04 devstack cinder-volume[87207]: import eventlet # noqa Sep 09 16:44:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 09 16:44:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 09 16:44:07 devstack cinder-volume[87207]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87207) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 09 16:44:08 devstack cinder-volume[87207]: INFO dbcounter [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Registered counter for database cinder Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_db.sqlalchemy.engines [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writer thread running {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 16:44:08 devstack cinder-volume[87207]: INFO cinder.rpc [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 09 16:44:08 devstack cinder-volume[87207]: INFO cinder.rpc [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_db.sqlalchemy.engines [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:44:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Determined volume DB was empty at startup. Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG cinder.volume.manager [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87207) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 09 16:44:08 devstack cinder-volume[87207]: WARNING stevedore.named [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 09 16:44:08 devstack cinder-volume[87207]: WARNING castellan.key_manager [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 16:44:08 devstack cinder-volume[87207]: WARNING cinder.keymgr.conf_key_mgr [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 09 16:44:08 devstack cinder-volume[87207]: INFO cinder.volume.manager [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_db.sqlalchemy.engines [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87207) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:44:08 devstack cinder-volume[87207]: INFO oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Starting 1 workers Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Started child 87498 {{(pid=87207) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Full set of CONF: {{(pid=87207) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] ******************************************************************************** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] Configuration options gathered from: {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] ================================================================================ {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] allow_availability_zone_fallback = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] allow_compression_on_image_upload = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] allowed_direct_url_schemes = [] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] api_rate_limit = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] auth_strategy = keystone {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_availability_zone = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_host = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_name = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_stats_polling_interval = 60 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backup_api_class = cinder.backup.api.API {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87498]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backup_name_template = backup-%s {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backup_use_same_host = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backup_use_temp_snapshot = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] chap_password = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] chap_username = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cinder_internal_tenant_project_id = 7cdeb79670b649a9aa4cf8c7172b4dc8 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cinder_internal_tenant_user_id = 02ba72f224cc428d80f4bac4adf15efe {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cluster = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] compression_format = gzip {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] compute_api_class = cinder.compute.nova.API {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] config_dir = [] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] config_source = [] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] control_exchange = openstack {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] debug = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] default_availability_zone = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] default_group_type = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] default_volume_type = QuobyteHD {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] disk_geometry = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] driver_client_cert = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] driver_client_cert_key = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] driver_data_namespace = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] driver_ssl_cert_path = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] driver_ssl_cert_verify = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] driver_use_ssl = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] enable_new_services = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] enable_unsupported_driver = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] enabled_backends = ['QuobyteHD'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] enforce_multipath_for_image_xfer = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] filter_function = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance_api_insecure = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance_api_servers = ['http://192.168.122.110/image'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance_api_ssl_compression = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance_ca_certificates_file = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance_catalog_info = image:glance:publicURL {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance_certfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance_keyfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance_num_retries = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance_request_timeout = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] goodness_function = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] graceful_shutdown_timeout = 5 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] group_api_class = cinder.group.api.API {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] host = devstack {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] image_compress_on_upload = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] image_conversion_address_space_limit = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] image_conversion_cpu_limit = 60 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] image_conversion_disable = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] image_upload_use_cinder_backend = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] image_upload_use_internal_tenant = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] image_volume_cache_enabled = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] image_volume_cache_max_count = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] image_volume_cache_max_size_gb = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] init_host_max_objects_retrieval = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] instance_format = [instance: %(uuid)s] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] iscsi_target_flags = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] iscsi_write_cache = on {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] iser_helper = tgtadm {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] iser_ip_address = 192.168.122.110 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] iser_port = 3260 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] log_color = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] log_config_append = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] log_dir = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] log_file = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] log_options = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] log_rotate_interval = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] log_rotate_interval_type = days {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] log_rotation_type = none {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] max_age = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] max_logfile_count = 30 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] max_logfile_size_mb = 200 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] max_over_subscription_ratio = 20.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] message_reap_interval = 86400 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] message_ttl = 2592000 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] migration_create_volume_timeout_secs = 300 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87498) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] monkey_patch = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] monkey_patch_modules = [] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] my_ip = 192.168.122.110 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] no_snapshot_gb_quota = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] num_iser_scan_tries = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] num_shell_tries = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] num_volume_device_scan_tries = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] nvmeof_conn_info_version = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] nvmet_ns_id = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] nvmet_port_id = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] osapi_max_limit = 1000 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] osapi_volume_ext_list = [] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] osapi_volume_listen = 0.0.0.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] osapi_volume_listen_port = 8776 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] osapi_volume_use_ssl = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] osapi_volume_workers = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] per_volume_size_limit = -1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] periodic_fuzzy_delay = 60 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] periodic_interval = 60 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] project_id_regex = [0-9a-f\-]+ {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] public_endpoint = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] publish_errors = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] quota_backup_gigabytes = 1000 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] quota_backups = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] quota_gigabytes = 1000 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] quota_groups = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] quota_snapshots = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] quota_volumes = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] rate_limit_burst = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] rate_limit_except_level = CRITICAL {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] rate_limit_interval = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] reinit_driver_count = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] replication_device = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] report_discard_supported = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] report_interval = 120 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] reservation_clean_interval = 86400 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] reservation_expire = 86400 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] reserved_image_namespaces = [] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] reserved_percentage = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] rpc_response_timeout = 120 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] run_external_periodic_tasks = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] scst_target_driver = iscsi {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] scst_target_iqn_name = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_down_time = 720 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] shell_completion = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] snapshot_name_template = snapshot-%s {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] split_loggers = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] state_path = /opt/stack/data/cinder {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] storage_availability_zone = nova {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] storage_protocol = iSCSI {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] syslog_log_facility = LOG_USER {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] target_helper = lioadm {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] target_ip_address = 192.168.122.110 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] target_port = 3260 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] target_protocol = iscsi {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] target_secondary_ip_addresses = [] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] trace_flags = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] transfer_api_class = cinder.transfer.api.API {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] transport_url = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] until_refresh = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] use_chap_auth = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] use_default_quota_class = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] use_journal = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] use_json = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] use_multipath_for_image_xfer = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] use_stderr = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] use_syslog = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] verify_glance_signatures = enabled {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_api_class = cinder.volume.api.API {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_backend_name = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_clear = zero {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_clear_ionice = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_clear_size = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_copy_bps_limit = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_dd_blocksize = 1M {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_name_template = volume-%s {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_service_inithost_offload = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volume_usage_audit_period = month {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] zoning_mode = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_concurrency.disable_process_locking = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.auth_section = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.auth_type = password {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.auth_version = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.cache = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.certfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.delay_auth_decision = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.http_connect_timeout = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.include_service_catalog = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.insecure = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.interface = public {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.keyfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_password = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87498) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 09 16:44:08 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.quobyte [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcache_username = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.region_name = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.service_token_roles_required = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.quobyte [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.service_type = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.token_cache_time = 300 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.110/identity {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.backend = dogpile.cache.null {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.backend_argument = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.backend_expiration_time = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.config_prefix = cache.oslo {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.debug_cache_backend = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.enable_retry_client = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.enable_socket_keepalive = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Running cmd (subprocess): mount.quobyte {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.enabled = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.expiration_time = 600 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.hashclient_retry_attempts = 2 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.memcache_dead_retry = 300 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.memcache_pool_maxsize = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.memcache_sasl_enabled = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.password = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.proxies = [] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.redis_db = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.redis_sentinel_service_name = mymaster {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.redis_server = localhost:6379 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.retry_attempts = 2 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.retry_delay = 0.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.socket_keepalive_count = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.socket_keepalive_idle = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.socket_keepalive_interval = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.socket_timeout = 1.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.tls_allowed_ciphers = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.tls_cafile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.tls_certfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.tls_enabled = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.tls_keyfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cache.username = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] coordination.backend_url = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.asyncio_connection = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.asyncio_slave_connection = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.backend = sqlalchemy {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.connection = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.connection_debug = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.connection_parameters = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.connection_recycle_time = 3600 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.connection_trace = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.db_inc_retry_interval = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.db_max_retries = 20 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.db_max_retry_interval = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.db_retry_interval = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.max_overflow = 50 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.max_pool_size = 5 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.max_retries = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.mysql_wsrep_sync_wait = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.pool_timeout = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.retry_interval = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.slave_connection = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.sqlite_synchronous = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.synchronous_reader = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] database.use_db_reconnect = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_tracing.insecure = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.connection_string = messaging:// {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.enabled = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.es_doc_type = notification {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.es_scroll_size = 10000 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.es_scroll_time = 2m {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.filter_error_trace = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.hmac_keys = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.sentinel_service_name = mymaster {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.socket_timeout = 0.1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.trace_requests = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler.trace_sqlalchemy = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler_jaeger.process_tags = {} {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler_jaeger.service_name_prefix = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] profiler_otlp.service_name_prefix = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_policy.enforce_new_defaults = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_policy.policy_default_rule = default {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_policy.policy_file = policy.yaml {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_policy.remote_timeout = 60.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] privsep_osbrick.group = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] privsep_osbrick.helper_command = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] privsep_osbrick.user = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cinder_sys_admin.group = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cinder_sys_admin.helper_command = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] cinder_sys_admin.user = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.auth_section = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.auth_type = password {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.cafile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.certfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.collect_timing = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.insecure = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.keyfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.send_service_user_token = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.split_loggers = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.timeout = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.tls_ciphers = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] service_user.tls_min_version = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.auth_section = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.auth_type = password {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.certfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.collect_timing = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.insecure = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.keyfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.region_name = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.split_loggers = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.timeout = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.tls_ciphers = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] glance.tls_min_version = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] CMD "mount.quobyte" returned: 1 in 0.050s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.backend_availability_zone = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.chap_password = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.chap_username = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.disk_geometry = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.driver_client_cert = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.driver_client_cert_key = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:08 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.driver_data_namespace = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.driver_use_ssl = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.enable_unsupported_driver = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.extra_capabilities = {} {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.filter_function = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.goodness_function = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.iscsi_target_flags = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.iscsi_write_cache = on {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.iser_helper = tgtadm {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.iser_ip_address = 192.168.122.110 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.iser_port = 3260 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nas_host = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nas_login = admin {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nas_mount_options = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nas_password = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nas_private_key = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nas_share_path = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nas_ssh_port = 22 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.num_shell_tries = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.nvmet_port_id = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.quobyte_client_cfg = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.quobyte_volume_url = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.replication_device = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.report_discard_supported = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.reserved_percentage = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.scst_target_driver = iscsi {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.scst_target_iqn_name = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.storage_protocol = iSCSI {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.target_helper = tgtadm {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.target_ip_address = 192.168.122.110 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.target_port = 3260 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.target_protocol = iscsi {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.trace_flags = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.unique_fqdn_network = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.use_chap_auth = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.volume_backend_name = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.volume_clear = zero {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.volume_clear_ionice = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.volume_clear_size = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_reports.file_event_handler = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_reports.log_dir = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.backend_availability_zone = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:44:09 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.backend_host = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.chap_password = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.chap_username = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.chiscsi_conf = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.disk_geometry = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.driver_client_cert = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.driver_client_cert_key = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.driver_data_namespace = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.driver_use_ssl = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.extra_capabilities = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.filter_function = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.goodness_function = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.iscsi_target_flags = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.iscsi_write_cache = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.iser_helper = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.iser_ip_address = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.iser_port = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.iser_target_prefix = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nas_host = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nas_login = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nas_mount_options = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nas_password = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nas_private_key = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nas_share_path = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nas_ssh_port = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.num_shell_tries = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nvmet_ns_id = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.nvmet_port_id = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.replication_device = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.report_discard_supported = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.reserved_percentage = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.scst_target_driver = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.storage_protocol = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.target_helper = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.target_ip_address = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.target_port = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.target_prefix = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.target_protocol = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.trace_flags = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.unique_fqdn_network = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.use_chap_auth = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.volume_clear = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.volume_clear_ionice = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.volume_clear_size = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] QuobyteHD.volumes_dir = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.ssl = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.ssl_version = {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_notifications.driver = [] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_notifications.retry = -1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] oslo_messaging_notifications.transport_url = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] key_manager.fixed_key = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.barbican_api_version = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.barbican_endpoint = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.barbican_endpoint_type = public {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.barbican_region_name = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.cafile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.certfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.collect_timing = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.insecure = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.keyfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.number_of_retries = 60 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.retry_delay = 1 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.send_service_user_token = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.split_loggers = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.timeout = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.tls_ciphers = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.tls_min_version = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.verify_ssl = True {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican.verify_ssl_path = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.auth_section = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.auth_type = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.cafile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.certfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.collect_timing = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.insecure = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.keyfile = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.split_loggers = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.timeout = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.tls_ciphers = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] barbican_service_user.tls_min_version = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.approle_role_id = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.approle_secret_id = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.auth_method = approle {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.auth_path = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.kv_mountpoint = secret {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.kv_path = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.kv_version = 2 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.namespace = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.root_token_id = **** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.ssl_ca_crt_file = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.timeout = 60.0 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.token_file = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.token_role = None {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.use_ssl = False {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 09 16:44:09 devstack cinder-volume[87207]: DEBUG oslo_service.backend._eventlet.service [None req-42268686-d2df-4396-a00f-f01c20e2a50c None None] ******************************************************************************** {{(pid=87207) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 09 16:44:09 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.267s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:44:09 devstack cinder-volume[87498]: INFO cinder.volume.driver [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Driver hasn't implemented _init_vendor_properties() Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.volume.driver [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3467407226562, 'free_capacity_gb': 1773.3467407226562, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_db.sqlalchemy.engines [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writer thread running {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.db.api [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Building query based on filter {{(pid=87498) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87498) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:44:09 devstack cinder-volume[87498]: INFO cinder.keymgr.migration [None req-ae340fde-1722-4055-883e-daddfbac9463 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 09 16:44:09 devstack sudo[87511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:44:09 devstack sudo[87511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:44:09 devstack sudo[87511]: pam_unix(sudo:session): session closed for user root Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:44:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Driver initialization completed successfully. Sep 09 16:44:09 devstack cinder-volume[87498]: INFO cinder.manager [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Initiating service 3 cleanup Sep 09 16:44:09 devstack cinder-volume[87498]: INFO cinder.manager [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Service 3 cleanup completed. Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.service [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Creating RPC server for service cinder-volume {{(pid=87498) start /opt/stack/cinder/cinder/service.py:231}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.service [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87498) start /opt/stack/cinder/cinder/service.py:237}} Sep 09 16:44:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:44:09 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:44:09 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:44:09 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Sep 09 16:44:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:44:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d33cbbc3-27d8-4ad1-a7d7-c425b6103563 None None] Driver post RPC initialization completed successfully. Sep 09 16:44:18 devstack cinder-volume[87207]: DEBUG dbcounter [-] [87207] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87207) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:44:19 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:44:19 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:44:44 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:44:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 6 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:44:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Flow 'volume_create_manager' (b506aeea-3943-4e8c-8408-575b4d5703aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e15f8d-dc3d-404e-9200-da08ddc86d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e15f8d-dc3d-404e-9200-da08ddc86d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-619078572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214aef27-99b4-4a9b-874c-f5897da27410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1440a42ebb4347cb9d2976f08ed846b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:45:24Z,use_quota=True,user_id='2145f30973d946f38f0fb41fb2ec596a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da9572f-6dfb-4455-b0ab-8018f9467c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da9572f-6dfb-4455-b0ab-8018f9467c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d51769-8941-43e6-b4c8-880945110a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d51769-8941-43e6-b4c8-880945110a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '214aef27-99b4-4a9b-874c-f5897da27410', 'volume_name': 'volume-214aef27-99b4-4a9b-874c-f5897da27410', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64524ab-a587-48bd-96e1-903605dc48b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c64524ab-a587-48bd-96e1-903605dc48b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473f6ccf-81b5-42f4-b752-2050b11770e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Volume 214aef27-99b4-4a9b-874c-f5897da27410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-214aef27-99b4-4a9b-874c-f5897da27410', 'volume_size': 1} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:45:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-619078572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=214aef27-99b4-4a9b-874c-f5897da27410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1440a42ebb4347cb9d2976f08ed846b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:45:24Z,use_quota=True,user_id='2145f30973d946f38f0fb41fb2ec596a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Creating volume 214aef27-99b4-4a9b-874c-f5897da27410 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:45:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:45:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:24 devstack sudo[88327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410 1073741824 Sep 09 16:45:24 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:26 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410 1073741824" returned: 0 in 1.544s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:26 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410 Sep 09 16:45:26 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:26 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:45:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (473f6ccf-81b5-42f4-b752-2050b11770e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-214aef27-99b4-4a9b-874c-f5897da27410', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b928db-c74c-489d-a7e0-1236e7d76472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Volume volume-214aef27-99b4-4a9b-874c-f5897da27410 (214aef27-99b4-4a9b-874c-f5897da27410): created successfully Sep 09 16:45:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27b928db-c74c-489d-a7e0-1236e7d76472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Flow 'volume_create_manager' (b506aeea-3943-4e8c-8408-575b4d5703aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:45:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4607e01c-beed-4f68-b30d-e948283b7f5c tempest-DeleteServersTestJSON-929866934 None] Created volume successfully. Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Flow 'volume_create_manager' (b7c7abbb-0eb7-42b3-9cae-e218a90c97ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d7cfb5-b80d-4a41-b916-c262c98c1885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4d7cfb5-b80d-4a41-b916-c262c98c1885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-348585220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fed1a1-062b-48b8-aec7-44a2ddc27fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2fa1d3e4d04f9f81caf0fdd02acdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:45:29Z,use_quota=True,user_id='ff09c9f22e404fad891f7be0d6c7b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e06d62d-ae60-4dfc-a447-80fa8811e92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e06d62d-ae60-4dfc-a447-80fa8811e92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63a174e-af82-46ca-9ab3-e052dfdd380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f63a174e-af82-46ca-9ab3-e052dfdd380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6fed1a1-062b-48b8-aec7-44a2ddc27fc1', 'volume_name': 'volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3f2c99-96b7-4077-8715-ba39c96682f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff3f2c99-96b7-4077-8715-ba39c96682f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b6b14c-f076-4624-af01-9525ddd6822c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Volume a6fed1a1-062b-48b8-aec7-44a2ddc27fc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1', 'volume_size': 1} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:45:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-348585220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6fed1a1-062b-48b8-aec7-44a2ddc27fc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d2fa1d3e4d04f9f81caf0fdd02acdde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:45:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:45:29Z,use_quota=True,user_id='ff09c9f22e404fad891f7be0d6c7b10e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Creating volume a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:45:29 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:45:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:29 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 1073741824 Sep 09 16:45:29 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:30 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 1073741824" returned: 0 in 0.810s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:30 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 Sep 09 16:45:30 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:30 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1" returned: 0 in 0.477s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:45:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.397s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b6b14c-f076-4624-af01-9525ddd6822c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce507315-438d-41ab-a185-337ae9a6baa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Volume volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 (a6fed1a1-062b-48b8-aec7-44a2ddc27fc1): created successfully Sep 09 16:45:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce507315-438d-41ab-a185-337ae9a6baa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Flow 'volume_create_manager' (b7c7abbb-0eb7-42b3-9cae-e218a90c97ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:45:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5da98cc7-defd-41ce-bf24-d1445e08d7dc tempest-VolumesAdminNegativeTest-382200555 None] Created volume successfully. Sep 09 16:45:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Acquiring lock "cinder-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:45:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Lock "cinder-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:45:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Acquiring lock "cinder-quobyte-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:45:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Lock "cinder-quobyte-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:45:32 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpsjfrh7hx/privsep.sock'] Sep 09 16:45:32 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpsjfrh7hx/privsep.sock Sep 09 16:45:32 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:33 devstack cinder-volume[87498]: WARNING py.warnings [req-be29ce41-4e68-4a1e-8753-f738eeaf837a req-50121f8b-bda0-4c6d-95c3-7ee17a646781 tempest-DeleteServersTestJSON-929866934 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 09 16:45:33 devstack cinder-volume[87498]: .first() Sep 09 16:45:33 devstack cinder-volume[87498]: Sep 09 16:45:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-be29ce41-4e68-4a1e-8753-f738eeaf837a req-50121f8b-bda0-4c6d-95c3-7ee17a646781 tempest-DeleteServersTestJSON-929866934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-be29ce41-4e68-4a1e-8753-f738eeaf837a req-50121f8b-bda0-4c6d-95c3-7ee17a646781 tempest-DeleteServersTestJSON-929866934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-be29ce41-4e68-4a1e-8753-f738eeaf837a req-50121f8b-bda0-4c6d-95c3-7ee17a646781 tempest-DeleteServersTestJSON-929866934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-be29ce41-4e68-4a1e-8753-f738eeaf837a req-50121f8b-bda0-4c6d-95c3-7ee17a646781 tempest-DeleteServersTestJSON-929866934 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-214aef27-99b4-4a9b-874c-f5897da27410', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd238e27b-f8b6-4879-97f9-16b15ef823d3', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:45:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-be29ce41-4e68-4a1e-8753-f738eeaf837a req-50121f8b-bda0-4c6d-95c3-7ee17a646781 tempest-DeleteServersTestJSON-929866934 None] attachment_update completed successfully. Sep 09 16:45:33 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 09 16:45:33 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 09 16:45:33 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 09 16:45:33 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: Sep 09 16:45:33 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 09 16:45:33 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 09 16:45:33 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 09 16:45:33 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: Sep 09 16:45:33 devstack cinder-volume[87498]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 09 16:45:34 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:34 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Spawned new privsep daemon via rootwrap Sep 09 16:45:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Accepted privsep connection to /tmp/tmpsjfrh7hx/privsep.sock {{(pid=87498) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 09 16:45:34 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 09 16:45:34 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 09 16:45:34 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 09 16:45:34 devstack cinder-volume[87498]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88694 Sep 09 16:45:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d966b48a-6724-4755-9781-c907b4d0d9b5]: (2,) {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:45:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb44e945-829c-4834-92eb-b8dd886b6bc7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:45:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:34 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 Sep 09 16:45:34 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:34 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1" returned: 0 in 0.685s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:35 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1 Sep 09 16:45:35 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:35 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1" returned: 0 in 0.642s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Lock "cinder-quobyte-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1" released by "delete_volume" :: held 3.607s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:45:35 devstack cinder-volume[87498]: WARNING cinder.quota [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:45:35 devstack cinder-volume[87498]: WARNING cinder.quota [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:45:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Created reservations ['ebf5d1d4-af80-498a-9c9f-44187f8b738c', '490da7cb-5cc5-4d72-91dd-f96b46f02be6', 'e5812a44-458a-4158-bcab-0796a24d06bc', '3893f4ed-3d5c-4969-9b4c-ae362f1648f1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:45:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:36 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:45:36 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:36 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.400s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:45:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Deleted volume successfully. Sep 09 16:45:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc258f9b-1edc-44c2-b038-027f232db738 tempest-VolumesAdminNegativeTest-382200555 None] Lock "cinder-a6fed1a1-062b-48b8-aec7-44a2ddc27fc1-delete_volume" released by "delete_volume" :: held 4.730s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:45:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-6226de76-407d-49d9-8642-c5b499e5e9a2 req-78a36f9a-dd48-44f6-b577-7d186b3682b7 tempest-DeleteServersTestJSON-929866934 None] Terminate volume connection completed successfully. Sep 09 16:45:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6226de76-407d-49d9-8642-c5b499e5e9a2 req-78a36f9a-dd48-44f6-b577-7d186b3682b7 tempest-DeleteServersTestJSON-929866934 None] Deleting attachment d238e27b-f8b6-4879-97f9-16b15ef823d3. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:45:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Acquiring lock "cinder-214aef27-99b4-4a9b-874c-f5897da27410-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:45:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Lock "cinder-214aef27-99b4-4a9b-874c-f5897da27410-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:45:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Acquiring lock "cinder-quobyte-214aef27-99b4-4a9b-874c-f5897da27410" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:45:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Lock "cinder-quobyte-214aef27-99b4-4a9b-874c-f5897da27410" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:45:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a1b2db-9b54-4016-8d0f-66cff76eda00]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:45:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:40 devstack sudo[89211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410 Sep 09 16:45:40 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:41 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:41 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410 Sep 09 16:45:41 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:41 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-214aef27-99b4-4a9b-874c-f5897da27410" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Lock "cinder-quobyte-214aef27-99b4-4a9b-874c-f5897da27410" released by "delete_volume" :: held 0.708s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Created reservations ['58d7123e-99ef-4e83-94f0-b336c3ed3eb4', '57a4db4d-11ba-4632-be8a-32da364e4e40', 'c24d973f-6645-47ee-aa58-6d9d76dafedc', 'e6eadee7-6b74-4157-aa06-2e5f8ea52d02'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:41 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:45:41 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:41 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:45:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Deleted volume successfully. Sep 09 16:45:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-96403cf9-f2f8-429a-91fc-8e10e190cf02 tempest-DeleteServersTestJSON-929866934 None] Lock "cinder-214aef27-99b4-4a9b-874c-f5897da27410-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:45:44 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:45:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:45:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:45:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:45 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:45:45 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:45 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:45:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:45:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:45:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Flow 'volume_create_manager' (82bf2b1e-9dba-4f7d-bb96-b1c394990c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212b3757-f7e1-445b-9c81-4f7ac9d6e1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (212b3757-f7e1-445b-9c81-4f7ac9d6e1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1242685809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33da5416-edff-4f40-990e-2256d714c9e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5edb187726748ed8b501812cd6a171c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:45:50Z,use_quota=True,user_id='b7873afcfc26477dadda92240cf68d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f62c11-ae70-4665-9030-5f204ff10d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f62c11-ae70-4665-9030-5f204ff10d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3723d3c-aaec-4284-a2fa-cc0d3c798b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3723d3c-aaec-4284-a2fa-cc0d3c798b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33da5416-edff-4f40-990e-2256d714c9e0', 'volume_name': 'volume-33da5416-edff-4f40-990e-2256d714c9e0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c2dd5e-0670-4cb1-920f-04204fc056f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75c2dd5e-0670-4cb1-920f-04204fc056f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e90ca00-10ee-4b3e-80ad-47b75df61e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Volume 33da5416-edff-4f40-990e-2256d714c9e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33da5416-edff-4f40-990e-2256d714c9e0', 'volume_size': 1} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1242685809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33da5416-edff-4f40-990e-2256d714c9e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5edb187726748ed8b501812cd6a171c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:45:50Z,use_quota=True,user_id='b7873afcfc26477dadda92240cf68d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Creating volume 33da5416-edff-4f40-990e-2256d714c9e0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:45:49 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:45:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:49 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0 1073741824 Sep 09 16:45:49 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:50 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0 1073741824" returned: 0 in 0.579s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:45:50 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0 Sep 09 16:45:50 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:45:50 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Sep 09 16:45:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:45:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:45:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e90ca00-10ee-4b3e-80ad-47b75df61e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33da5416-edff-4f40-990e-2256d714c9e0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080ecd9d-1bcd-4cdd-b5bc-44e1a46f92c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:45:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Volume volume-33da5416-edff-4f40-990e-2256d714c9e0 (33da5416-edff-4f40-990e-2256d714c9e0): created successfully Sep 09 16:45:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (080ecd9d-1bcd-4cdd-b5bc-44e1a46f92c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:45:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Flow 'volume_create_manager' (82bf2b1e-9dba-4f7d-bb96-b1c394990c80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:45:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7a130eee-009a-45f0-9822-6955a3212c35 tempest-AttachVolumeTestJSON-953561773 None] Created volume successfully. Sep 09 16:45:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-fddc263b-fcfa-47dc-8edb-7b943c9ec85f req-71280107-30a6-4c73-9dea-34c1bca09cb7 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:45:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-fddc263b-fcfa-47dc-8edb-7b943c9ec85f req-71280107-30a6-4c73-9dea-34c1bca09cb7 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:45:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-fddc263b-fcfa-47dc-8edb-7b943c9ec85f req-71280107-30a6-4c73-9dea-34c1bca09cb7 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:45:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-fddc263b-fcfa-47dc-8edb-7b943c9ec85f req-71280107-30a6-4c73-9dea-34c1bca09cb7 tempest-AttachVolumeTestJSON-953561773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-33da5416-edff-4f40-990e-2256d714c9e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e59838ae-f555-4925-a8b7-7ec565ac364e', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:45:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-fddc263b-fcfa-47dc-8edb-7b943c9ec85f req-71280107-30a6-4c73-9dea-34c1bca09cb7 tempest-AttachVolumeTestJSON-953561773 None] attachment_update completed successfully. Sep 09 16:46:03 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=29,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:46:03 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=25,cinder:SELECT=31,cinder:DELETE=3,cinder:INSERT=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:46:19 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:46:20 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Flow 'volume_create_manager' (d3149f8a-07d4-4c68-9e17-f0acedea62b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c07be9d-046f-456d-83c6-d660eee38332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c07be9d-046f-456d-83c6-d660eee38332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1028610965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a44925-3ccd-4ac4-b4a1-3fefd04b9593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ef2c8749494487bc1dad1523166604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:46:26Z,use_quota=True,user_id='809ed4afd60341eba78155a69ed77298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127ecae2-caea-4586-91ea-1c71a3dd784f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127ecae2-caea-4586-91ea-1c71a3dd784f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b8674c-b8ac-497b-8531-3b8d2ba939bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b8674c-b8ac-497b-8531-3b8d2ba939bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00a44925-3ccd-4ac4-b4a1-3fefd04b9593', 'volume_name': 'volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcfc6b0-5453-4526-b9c2-d4cb81bb12df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efcfc6b0-5453-4526-b9c2-d4cb81bb12df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e071281e-ce25-4f18-8e7a-f2b17b998bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Volume 00a44925-3ccd-4ac4-b4a1-3fefd04b9593: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593', 'volume_size': 1} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:46:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1028610965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00a44925-3ccd-4ac4-b4a1-3fefd04b9593,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ef2c8749494487bc1dad1523166604',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:46:26Z,use_quota=True,user_id='809ed4afd60341eba78155a69ed77298',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Creating volume 00a44925-3ccd-4ac4-b4a1-3fefd04b9593 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:46:26 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:46:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:46:26 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593 1073741824 Sep 09 16:46:26 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:46:27 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Sep 09 16:46:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593 1073741824" returned: 0 in 1.194s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:46:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:46:27 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593 Sep 09 16:46:27 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:46:28 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Sep 09 16:46:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:46:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:46:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:46:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e071281e-ce25-4f18-8e7a-f2b17b998bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f51d7d-79f9-44e3-b453-4fc30b781f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Volume volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593 (00a44925-3ccd-4ac4-b4a1-3fefd04b9593): created successfully Sep 09 16:46:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f51d7d-79f9-44e3-b453-4fc30b781f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Flow 'volume_create_manager' (d3149f8a-07d4-4c68-9e17-f0acedea62b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:46:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3977fa84-9e18-4fa8-b6ad-0ea906eddf51 tempest-TaggedAttachmentsTest-446030366 None] Created volume successfully. Sep 09 16:46:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-85388bad-056e-4066-b7cc-8b7d75d1ea3d req-5b07526d-d8ae-48e7-a4d3-e7dedfb7ebc0 tempest-AttachVolumeTestJSON-953561773 None] Terminate volume connection completed successfully. Sep 09 16:46:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-85388bad-056e-4066-b7cc-8b7d75d1ea3d req-5b07526d-d8ae-48e7-a4d3-e7dedfb7ebc0 tempest-AttachVolumeTestJSON-953561773 None] Deleting attachment e59838ae-f555-4925-a8b7-7ec565ac364e. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:46:44 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:46:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:46:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:46:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:46:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:46:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:46:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:46:45 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:46:45 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:46:45 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Sep 09 16:46:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.403s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:46:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:46:48 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:46:48 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:46:51 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:46:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Flow 'volume_create_manager' (31de49a4-9f3d-4883-95c3-cbdc749bc9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:46:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988dbd6c-9678-4cfa-9e35-f6acc8db425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (988dbd6c-9678-4cfa-9e35-f6acc8db425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-666701401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd980e76-c6d7-4376-bf88-c060d5b7ea56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d2fb90bd8c4374b32a7bf4d67dd8ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:46:52Z,use_quota=True,user_id='8ae8b2f52b934dab8ead132b8ddba89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0adab7de-8684-448e-afd1-9474db892837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0adab7de-8684-448e-afd1-9474db892837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e544a48-62a8-47cf-9b22-0bbd6f972526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e544a48-62a8-47cf-9b22-0bbd6f972526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd980e76-c6d7-4376-bf88-c060d5b7ea56', 'volume_name': 'volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ab4281-08c3-4ad7-b40d-f6da2f6beb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ab4281-08c3-4ad7-b40d-f6da2f6beb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d97cf56-0b44-4e79-9a0d-00b9fd9d7b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Volume fd980e76-c6d7-4376-bf88-c060d5b7ea56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56', 'volume_size': 1} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-666701401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd980e76-c6d7-4376-bf88-c060d5b7ea56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5d2fb90bd8c4374b32a7bf4d67dd8ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:46:52Z,use_quota=True,user_id='8ae8b2f52b934dab8ead132b8ddba89e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Creating volume fd980e76-c6d7-4376-bf88-c060d5b7ea56 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.026s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:46:52 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:46:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:46:52 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56 1073741824 Sep 09 16:46:52 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:46:53 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Sep 09 16:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56 1073741824" returned: 0 in 1.069s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:46:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:46:53 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56 Sep 09 16:46:53 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:46:54 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Sep 09 16:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56" returned: 0 in 0.718s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] <== create_volume: return (1976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:46:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d97cf56-0b44-4e79-9a0d-00b9fd9d7b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372a550b-4ce3-4296-8fa5-51c21af01a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:46:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Volume volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56 (fd980e76-c6d7-4376-bf88-c060d5b7ea56): created successfully Sep 09 16:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (372a550b-4ce3-4296-8fa5-51c21af01a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:46:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Flow 'volume_create_manager' (31de49a4-9f3d-4883-95c3-cbdc749bc9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:46:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-edd4c057-a86c-4619-8b78-ea389219201e tempest-ServerRescueNegativeTestJSON-166808165 None] Created volume successfully. Sep 09 16:47:04 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:47:04 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:47:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Acquiring lock "cinder-fd980e76-c6d7-4376-bf88-c060d5b7ea56-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:47:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Lock "cinder-fd980e76-c6d7-4376-bf88-c060d5b7ea56-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:47:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Acquiring lock "cinder-quobyte-fd980e76-c6d7-4376-bf88-c060d5b7ea56" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:47:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Lock "cinder-quobyte-fd980e76-c6d7-4376-bf88-c060d5b7ea56" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:47:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae01f8e8-867b-487c-8e21-722beb169eec]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:47:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:06 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56 Sep 09 16:47:06 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:07 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56" returned: 0 in 0.619s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:07 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56 Sep 09 16:47:07 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:07 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fd980e76-c6d7-4376-bf88-c060d5b7ea56" returned: 0 in 0.551s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Lock "cinder-quobyte-fd980e76-c6d7-4376-bf88-c060d5b7ea56" released by "delete_volume" :: held 1.241s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Created reservations ['0005b76a-1f1f-4b10-ad89-8f9744f167d7', '2e569480-307d-4dce-87ce-00d31747fce5', '5990a679-2637-485c-ab5b-e7b6395e2fdb', '2c670324-6c24-4e85-9f56-71bcbb3c590f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:07 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:47:07 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:08 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.565s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:08 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:47:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Deleted volume successfully. Sep 09 16:47:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f7f35829-6557-4c3e-a94a-793587e241cb tempest-ServerRescueNegativeTestJSON-166808165 None] Lock "cinder-fd980e76-c6d7-4376-bf88-c060d5b7ea56-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:47:17 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=10,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:47:18 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Flow 'volume_create_manager' (b2c2f513-9d3a-4e4c-873f-583a5bcd1ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38da820e-f0e0-46e8-a195-49407d937ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38da820e-f0e0-46e8-a195-49407d937ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-794944992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251511e1-244a-4240-ae45-2ae5c8bd6875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc603a21e4a24159a76be6a4cb9a7c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:47:25Z,use_quota=True,user_id='ae486af7fc2d4ce784ea74a16782c78b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3977f37-6f7b-4bad-90c9-236af37c3ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3977f37-6f7b-4bad-90c9-236af37c3ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29706bb6-5205-49e6-afe2-6bf214f5a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29706bb6-5205-49e6-afe2-6bf214f5a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '251511e1-244a-4240-ae45-2ae5c8bd6875', 'volume_name': 'volume-251511e1-244a-4240-ae45-2ae5c8bd6875', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f255f1d-2a3c-4d28-98dc-c58d95088481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f255f1d-2a3c-4d28-98dc-c58d95088481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424894d0-a1c8-425a-b6ff-9defcb09c9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Volume 251511e1-244a-4240-ae45-2ae5c8bd6875: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-251511e1-244a-4240-ae45-2ae5c8bd6875', 'volume_size': 1} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-794944992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=251511e1-244a-4240-ae45-2ae5c8bd6875,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc603a21e4a24159a76be6a4cb9a7c48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:47:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:47:25Z,use_quota=True,user_id='ae486af7fc2d4ce784ea74a16782c78b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Creating volume 251511e1-244a-4240-ae45-2ae5c8bd6875 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:47:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:47:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:25 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 1073741824 Sep 09 16:47:25 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:25 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 1073741824" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:25 devstack sudo[91107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 Sep 09 16:47:25 devstack sudo[91107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:25 devstack sudo[91107]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:47:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (424894d0-a1c8-425a-b6ff-9defcb09c9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-251511e1-244a-4240-ae45-2ae5c8bd6875', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088f8664-5085-4bd1-9c09-3d121b0c44ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Volume volume-251511e1-244a-4240-ae45-2ae5c8bd6875 (251511e1-244a-4240-ae45-2ae5c8bd6875): created successfully Sep 09 16:47:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (088f8664-5085-4bd1-9c09-3d121b0c44ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Flow 'volume_create_manager' (b2c2f513-9d3a-4e4c-873f-583a5bcd1ae6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:47:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-6419e80b-8eae-487d-bc1c-d8957e24115f req-e10564d8-5167-410d-86ec-54bd2207dffd tempest-VolumesSnapshotsTestJSON-357477198 None] Created volume successfully. Sep 09 16:47:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Creating offline snapshot ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a of volume 251511e1-244a-4240-ae45-2ae5c8bd6875 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:47:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e440542a-3cda-495f-a2b6-c7117f5f3227]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:47:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:26 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 Sep 09 16:47:26 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:26 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:26 devstack sudo[91115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a 1G Sep 09 16:47:26 devstack sudo[91115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:27 devstack sudo[91115]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a 1G" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251511e1-244a-4240-ae45-2ae5c8bd6875 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:27 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251511e1-244a-4240-ae45-2ae5c8bd6875 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a Sep 09 16:47:27 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:27 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-251511e1-244a-4240-ae45-2ae5c8bd6875 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a" returned: 0 in 0.273s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:27 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a is being set with open permissions: ugo+rw Sep 09 16:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:27 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a Sep 09 16:47:27 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:27 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:27 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.info Sep 09 16:47:27 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:27 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.info" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:27 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.info is being set with open permissions: ugo+rw Sep 09 16:47:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:27 devstack sudo[91132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.info Sep 09 16:47:27 devstack sudo[91132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:28 devstack sudo[91132]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.info" returned: 0 in 0.229s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-7c3a35a4-5c32-43e7-a5b7-28e70b870487 req-e442360c-f077-41a3-ac67-83293507796b tempest-VolumesSnapshotsTestJSON-357477198 None] Create snapshot completed successfully Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Acquiring lock "cinder-ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "cinder-ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Acquiring lock "cinder-quobyte-251511e1-244a-4240-ae45-2ae5c8bd6875" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "cinder-quobyte-251511e1-244a-4240-ae45-2ae5c8bd6875" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Acquiring lock "cinder-quobyte-ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "cinder-quobyte-ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Deleting offline snapshot ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a of volume 251511e1-244a-4240-ae45-2ae5c8bd6875 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] snapshot_file for this snap is: volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdebffa7-866e-4ceb-bb99-b4b84d891e42]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:29 devstack sudo[91135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a Sep 09 16:47:29 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:29 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-251511e1-244a-4240-ae45-2ae5c8bd6875(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bbe7a6-45e3-40da-a6db-26b6234151dd]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:29 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 Sep 09 16:47:29 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:29 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:29 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a Sep 09 16:47:29 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:30 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:30 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a Sep 09 16:47:30 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:30 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875.ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "cinder-quobyte-ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a" released by "_delete_snapshot" :: held 1.443s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:47:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "cinder-quobyte-251511e1-244a-4240-ae45-2ae5c8bd6875" released by "delete_snapshot" :: held 1.467s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:47:30 devstack cinder-volume[87498]: WARNING cinder.quota [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:47:30 devstack cinder-volume[87498]: DEBUG cinder.quota [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Created reservations ['e891d2a1-800e-46ec-95a8-acc7be1b3bac', '6b9e61fa-0331-4713-8a40-8a2e18727cfa', '42fef1f0-e514-43fe-a68a-09dc4bcdc66e', 'b1ba9dd6-a8ca-4768-beb1-42dac271ad9d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:47:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Delete snapshot completed successfully. Sep 09 16:47:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-fb7b10f8-516a-4bd8-b421-d2709d14332f req-3eff2459-daa9-4306-9480-361fe0a9db59 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "cinder-ee4b19aa-8b3e-48f0-9c97-0dd62043ba4a-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:47:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Acquiring lock "cinder-251511e1-244a-4240-ae45-2ae5c8bd6875-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:47:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "cinder-251511e1-244a-4240-ae45-2ae5c8bd6875-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:47:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Acquiring lock "cinder-quobyte-251511e1-244a-4240-ae45-2ae5c8bd6875" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:47:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "cinder-quobyte-251511e1-244a-4240-ae45-2ae5c8bd6875" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:47:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39721fb-7c64-4187-b71f-3a6a87d6f298]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:47:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:31 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 Sep 09 16:47:31 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:31 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875" returned: 0 in 0.427s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:31 devstack sudo[91188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875 Sep 09 16:47:31 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:32 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-251511e1-244a-4240-ae45-2ae5c8bd6875" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "cinder-quobyte-251511e1-244a-4240-ae45-2ae5c8bd6875" released by "delete_volume" :: held 0.806s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG cinder.quota [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Created reservations ['bfb79659-3793-4afd-872c-b7f039b9b878', 'f7d96854-cff7-49d3-8d73-8c0564bcd941', 'f289948b-dd31-45be-8863-8622624262c2', '6b4045f3-1f1b-47ee-9ae2-4cd2208275b1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:32 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:47:32 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:32 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG cinder.manager [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:47:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Deleted volume successfully. Sep 09 16:47:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d0795ca1-e540-4820-a37c-67ce3f932dec req-a22b5dec-c3c5-4bc0-8bad-917a89e5a611 tempest-VolumesSnapshotsTestJSON-357477198 None] Lock "cinder-251511e1-244a-4240-ae45-2ae5c8bd6875-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Flow 'volume_create_manager' (75562656-c6bf-4221-8cbf-bbc2699ce956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1f4096-a914-4869-9022-5f4ff83cc420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1f4096-a914-4869-9022-5f4ff83cc420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-727390071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da34a62-fcf5-494b-a860-9e47fd021e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6126dee4ec4f79a43696cdb74d0ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:47:36Z,use_quota=True,user_id='6986ce9404da4e53a791a851dcb42f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69dce66-6466-41f3-a7d4-43b334d905a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69dce66-6466-41f3-a7d4-43b334d905a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c6b3ac-ee74-46cd-a22f-fe1834e4bea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41c6b3ac-ee74-46cd-a22f-fe1834e4bea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da34a62-fcf5-494b-a860-9e47fd021e89', 'volume_name': 'volume-6da34a62-fcf5-494b-a860-9e47fd021e89', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7594ac-5b85-4604-9eb5-7c391ada7360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7594ac-5b85-4604-9eb5-7c391ada7360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d37edd-49f2-4ee0-90cf-700120b647bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Volume 6da34a62-fcf5-494b-a860-9e47fd021e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da34a62-fcf5-494b-a860-9e47fd021e89', 'volume_size': 1} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-727390071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da34a62-fcf5-494b-a860-9e47fd021e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b6126dee4ec4f79a43696cdb74d0ac1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:47:36Z,use_quota=True,user_id='6986ce9404da4e53a791a851dcb42f4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Creating volume 6da34a62-fcf5-494b-a860-9e47fd021e89 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:47:36 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:47:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:36 devstack sudo[91205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89 1073741824 Sep 09 16:47:36 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:37 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89 1073741824" returned: 0 in 0.674s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:37 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89 Sep 09 16:47:37 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:37 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89" returned: 0 in 0.387s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:47:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d37edd-49f2-4ee0-90cf-700120b647bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da34a62-fcf5-494b-a860-9e47fd021e89', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad715c9-7d93-4da8-8d75-bae387c985cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Volume volume-6da34a62-fcf5-494b-a860-9e47fd021e89 (6da34a62-fcf5-494b-a860-9e47fd021e89): created successfully Sep 09 16:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aad715c9-7d93-4da8-8d75-bae387c985cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Flow 'volume_create_manager' (75562656-c6bf-4221-8cbf-bbc2699ce956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:47:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c3d17ed4-1a44-4647-b5ab-8f85b1123009 tempest-AttachVolumeShelveTestJSON-744334827 None] Created volume successfully. Sep 09 16:47:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-33a1372e-32df-4e19-9a65-eeff88d8d77e tempest-BackendsCapabilitiesAdminTestsJSON-1878477570 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3467407226562, 'free_capacity_gb': 1773.3467407226562, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 16:47:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9464b761-eb67-466d-9edd-25f33fa18a9b tempest-BackendsCapabilitiesAdminTestsJSON-1878477570 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3467407226562, 'free_capacity_gb': 1773.3467407226562, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 16:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-c9630c43-3c2c-4eca-b7e4-bfcab085cb4f req-52c8528f-8c83-4b61-8220-c032f868fa15 tempest-TaggedAttachmentsTest-446030366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-c9630c43-3c2c-4eca-b7e4-bfcab085cb4f req-52c8528f-8c83-4b61-8220-c032f868fa15 tempest-TaggedAttachmentsTest-446030366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-c9630c43-3c2c-4eca-b7e4-bfcab085cb4f req-52c8528f-8c83-4b61-8220-c032f868fa15 tempest-TaggedAttachmentsTest-446030366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-c9630c43-3c2c-4eca-b7e4-bfcab085cb4f req-52c8528f-8c83-4b61-8220-c032f868fa15 tempest-TaggedAttachmentsTest-446030366 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b334362e-4d51-431a-a487-5ccee0fbaab4', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:47:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-c9630c43-3c2c-4eca-b7e4-bfcab085cb4f req-52c8528f-8c83-4b61-8220-c032f868fa15 tempest-TaggedAttachmentsTest-446030366 None] attachment_update completed successfully. Sep 09 16:47:44 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:47:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:45 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:47:45 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:45 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:47:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:47:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:47:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-ac38b378-9d54-41ad-8b05-b635cb04ee39 req-cd251254-8955-4572-b6ba-f8add7cd38c4 tempest-TaggedAttachmentsTest-446030366 None] Terminate volume connection completed successfully. Sep 09 16:47:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-ac38b378-9d54-41ad-8b05-b635cb04ee39 req-cd251254-8955-4572-b6ba-f8add7cd38c4 tempest-TaggedAttachmentsTest-446030366 None] Deleting attachment b334362e-4d51-431a-a487-5ccee0fbaab4. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:47:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e8eb999a-a24f-429e-a909-fb331ee9c482 tempest-GroupsTest-549040960 None] Group tempest-Group1-1550876218: creating Sep 09 16:47:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e8eb999a-a24f-429e-a909-fb331ee9c482 tempest-GroupsTest-549040960 None] Group tempest-Group1-1550876218: created successfully Sep 09 16:47:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e8eb999a-a24f-429e-a909-fb331ee9c482 tempest-GroupsTest-549040960 None] Create group completed successfully. Sep 09 16:47:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9bffa5d5-259e-491c-b21d-d0f2ff0cbac6 tempest-GroupsTest-549040960 None] Group tempest-Group2-983010258: creating Sep 09 16:47:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9bffa5d5-259e-491c-b21d-d0f2ff0cbac6 tempest-GroupsTest-549040960 None] Group tempest-Group2-983010258: created successfully Sep 09 16:47:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9bffa5d5-259e-491c-b21d-d0f2ff0cbac6 tempest-GroupsTest-549040960 None] Create group completed successfully. Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Flow 'volume_create_manager' (58a02040-1a04-4e41-b030-367581dd4d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d83a770-1a92-413c-89ca-28171e741782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d83a770-1a92-413c-89ca-28171e741782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-120707279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72437fe1-346c-47e2-88b2-676a3a65399e,host='devstack@QuobyteHD#QuobyteHD',id=790ff81f-b669-4780-9e8d-bd0db7f19c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf9b8c7da784c3d8455343ff3406cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:47:54Z,use_quota=True,user_id='befb69038e82480e894cee137c3c1339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3324213d-084a-4bf9-9e69-32c224cfd081),volume_type_id=3324213d-084a-4bf9-9e69-32c224cfd081)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2302f560-685e-4cf4-b90c-3c91226e3d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2302f560-685e-4cf4-b90c-3c91226e3d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9657c0-9e14-4a5a-84a9-57b4955a569d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9657c0-9e14-4a5a-84a9-57b4955a569d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790ff81f-b669-4780-9e8d-bd0db7f19c2b', 'volume_name': 'volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9846aade-6130-427e-8494-1b03d5cff820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9846aade-6130-427e-8494-1b03d5cff820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8de7ba3-d106-49e6-b9b5-14ff710acd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Volume 790ff81f-b669-4780-9e8d-bd0db7f19c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b', 'volume_size': 1} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=72437fe1-346c-47e2-88b2-676a3a65399e,created_at=2026-09-09T14:47:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-120707279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=72437fe1-346c-47e2-88b2-676a3a65399e,host='devstack@QuobyteHD#QuobyteHD',id=790ff81f-b669-4780-9e8d-bd0db7f19c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf9b8c7da784c3d8455343ff3406cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:47:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:47:54Z,use_quota=True,user_id='befb69038e82480e894cee137c3c1339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3324213d-084a-4bf9-9e69-32c224cfd081),volume_type_id=3324213d-084a-4bf9-9e69-32c224cfd081)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Creating volume 790ff81f-b669-4780-9e8d-bd0db7f19c2b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:47:54 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:47:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:54 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b 1073741824 Sep 09 16:47:54 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:55 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b 1073741824" returned: 0 in 1.062s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:55 devstack sudo[91885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b Sep 09 16:47:55 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-0ee2c28e-70db-43e3-8f19-aa547e93d8aa req-115f3ea2-dbd6-41a9-9d0e-cc3e023a9384 tempest-AttachVolumeShelveTestJSON-744334827 None] No connector for attachment 848ee299-7b20-4f1f-a261-48bbefa9a4b6; skipping storage backend terminate_connection call. {{(pid=87498) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 09 16:47:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-0ee2c28e-70db-43e3-8f19-aa547e93d8aa req-115f3ea2-dbd6-41a9-9d0e-cc3e023a9384 tempest-AttachVolumeShelveTestJSON-744334827 None] Deleting attachment 848ee299-7b20-4f1f-a261-48bbefa9a4b6. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:47:56 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b" returned: 0 in 0.454s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:47:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8de7ba3-d106-49e6-b9b5-14ff710acd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267dfd82-8828-4d74-ae12-376ecf3ec3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:47:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Volume volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b (790ff81f-b669-4780-9e8d-bd0db7f19c2b): created successfully Sep 09 16:47:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (267dfd82-8828-4d74-ae12-376ecf3ec3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:47:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Flow 'volume_create_manager' (58a02040-1a04-4e41-b030-367581dd4d85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:47:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8d0d9549-b7c1-4151-afd5-3b3829e47689 tempest-GroupsTest-549040960 None] Created volume successfully. Sep 09 16:47:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Acquiring lock "cinder-quobyte-790ff81f-b669-4780-9e8d-bd0db7f19c2b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:47:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Lock "cinder-quobyte-790ff81f-b669-4780-9e8d-bd0db7f19c2b" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:47:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ef8c4e-7b59-42e5-8792-0290e1959d0c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:47:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:58 devstack sudo[91897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b Sep 09 16:47:58 devstack sudo[91897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:58 devstack sudo[91897]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b" returned: 0 in 0.659s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:58 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b Sep 09 16:47:58 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:59 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-790ff81f-b669-4780-9e8d-bd0db7f19c2b" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Lock "cinder-quobyte-790ff81f-b669-4780-9e8d-bd0db7f19c2b" released by "delete_volume" :: held 1.009s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Created reservations ['346a4379-4784-455d-9444-31b89a208558'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:47:59 devstack cinder-volume[87498]: WARNING cinder.quota [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1391531071 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1391531071, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:47:59 devstack cinder-volume[87498]: WARNING cinder.quota [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1391531071 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1391531071, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Created reservations ['735eb110-1de0-4639-bcc8-4c600acb3f35', '16617850-129e-428f-98c0-357d0563e8f0', '14ddf4ff-0dbd-46b9-b962-82459a0e3b07', 'c77a5c4a-eaa7-47ac-88e2-9794ae9400ce'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:59 devstack sudo[91908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:47:59 devstack sudo[91908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-71d15340-5692-446a-963f-b6bc0e48b575 tempest-GroupsTest-549040960 None] Created reservations ['2f477999-2142-481f-b1c6-121a8ed33b65'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:47:59 devstack sudo[91908]: pam_unix(sudo:session): session closed for user root Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:47:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1e8abd46-8708-43cd-ba33-6cf11b6624bd tempest-GroupsTest-549040960 None] Delete group completed successfully. Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71d15340-5692-446a-963f-b6bc0e48b575 tempest-GroupsTest-549040960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71d15340-5692-446a-963f-b6bc0e48b575 tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71d15340-5692-446a-963f-b6bc0e48b575 tempest-GroupsTest-549040960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71d15340-5692-446a-963f-b6bc0e48b575 tempest-GroupsTest-549040960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71d15340-5692-446a-963f-b6bc0e48b575 tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:47:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-71d15340-5692-446a-963f-b6bc0e48b575 tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:47:59 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:47:59 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:00 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-71d15340-5692-446a-963f-b6bc0e48b575 tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:00 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-71d15340-5692-446a-963f-b6bc0e48b575 tempest-GroupsTest-549040960 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-71d15340-5692-446a-963f-b6bc0e48b575 tempest-GroupsTest-549040960 None] Delete group completed successfully. Sep 09 16:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Acquiring lock "cinder-00a44925-3ccd-4ac4-b4a1-3fefd04b9593-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Lock "cinder-00a44925-3ccd-4ac4-b4a1-3fefd04b9593-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Acquiring lock "cinder-quobyte-00a44925-3ccd-4ac4-b4a1-3fefd04b9593" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Lock "cinder-quobyte-00a44925-3ccd-4ac4-b4a1-3fefd04b9593" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c7b2d8-59c5-41d1-8f42-28fa981cf79b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:01 devstack sudo[91936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593 Sep 09 16:48:01 devstack sudo[91936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3ac5dba9-aeee-4a20-a62a-a40be013b2d9 tempest-GroupsTest-549040960 None] Group tempest-GroupsTest-Group-2081090985: creating Sep 09 16:48:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3ac5dba9-aeee-4a20-a62a-a40be013b2d9 tempest-GroupsTest-549040960 None] Group tempest-GroupsTest-Group-2081090985: created successfully Sep 09 16:48:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3ac5dba9-aeee-4a20-a62a-a40be013b2d9 tempest-GroupsTest-549040960 None] Create group completed successfully. Sep 09 16:48:02 devstack sudo[91936]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593" returned: 0 in 0.485s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:02 devstack sudo[91942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593 Sep 09 16:48:02 devstack sudo[91942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:02 devstack sudo[91942]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00a44925-3ccd-4ac4-b4a1-3fefd04b9593" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Lock "cinder-quobyte-00a44925-3ccd-4ac4-b4a1-3fefd04b9593" released by "delete_volume" :: held 0.844s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Created reservations ['8e408ac0-376c-48e9-ac32-a079c5f03b8a', '33e472f4-265f-4180-a92f-45d78e3ec878', '89cd9750-0487-4bab-9aeb-7d92f060cd78', '2233a51f-cabe-4569-b30d-000c6a4ca302'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:02 devstack sudo[91945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:48:02 devstack sudo[91945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:02 devstack sudo[91945]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Deleted volume successfully. Sep 09 16:48:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-84918a3d-622b-4ace-abf5-929d1dd307e0 tempest-TaggedAttachmentsTest-446030366 None] Lock "cinder-00a44925-3ccd-4ac4-b4a1-3fefd04b9593-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Flow 'volume_create_manager' (d0a0dbe1-f10e-418c-98e6-b90b9c05b28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b4833d-88c8-41c4-91d1-c2896bcb350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b4833d-88c8-41c4-91d1-c2896bcb350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-34192813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c24943a0-d273-4e70-97d2-e0a9e016b807,host='devstack@QuobyteHD#QuobyteHD',id=7670bff2-985e-4d98-8089-773c53cf2200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf9b8c7da784c3d8455343ff3406cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:04Z,use_quota=True,user_id='befb69038e82480e894cee137c3c1339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c391b8c2-4c64-44d0-8758-c7f72ecf73ba),volume_type_id=c391b8c2-4c64-44d0-8758-c7f72ecf73ba)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b09d5d-ee45-4376-940b-923f80b8af8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b09d5d-ee45-4376-940b-923f80b8af8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0a1a31-521c-4f49-ab80-385ed584801c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d0a1a31-521c-4f49-ab80-385ed584801c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7670bff2-985e-4d98-8089-773c53cf2200', 'volume_name': 'volume-7670bff2-985e-4d98-8089-773c53cf2200', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c294032-b5dc-4693-bb21-afae808bd90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c294032-b5dc-4693-bb21-afae808bd90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b220a111-8803-477e-81cd-c30723a87c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Volume 7670bff2-985e-4d98-8089-773c53cf2200: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7670bff2-985e-4d98-8089-773c53cf2200', 'volume_size': 1} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c24943a0-d273-4e70-97d2-e0a9e016b807,created_at=2026-09-09T14:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-34192813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c24943a0-d273-4e70-97d2-e0a9e016b807,host='devstack@QuobyteHD#QuobyteHD',id=7670bff2-985e-4d98-8089-773c53cf2200,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf9b8c7da784c3d8455343ff3406cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:04Z,use_quota=True,user_id='befb69038e82480e894cee137c3c1339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c391b8c2-4c64-44d0-8758-c7f72ecf73ba),volume_type_id=c391b8c2-4c64-44d0-8758-c7f72ecf73ba)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Creating volume 7670bff2-985e-4d98-8089-773c53cf2200 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:48:03 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:48:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:03 devstack sudo[91959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200 1073741824 Sep 09 16:48:03 devstack sudo[91959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:04 devstack sudo[91959]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200 1073741824" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:04 devstack sudo[91980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200 Sep 09 16:48:04 devstack sudo[91980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:04 devstack sudo[91980]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:48:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b220a111-8803-477e-81cd-c30723a87c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7670bff2-985e-4d98-8089-773c53cf2200', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7e4cbc-d8ab-4e88-8848-765ca3a241dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Volume volume-7670bff2-985e-4d98-8089-773c53cf2200 (7670bff2-985e-4d98-8089-773c53cf2200): created successfully Sep 09 16:48:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af7e4cbc-d8ab-4e88-8848-765ca3a241dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Flow 'volume_create_manager' (d0a0dbe1-f10e-418c-98e6-b90b9c05b28f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dd4c27b5-cbb6-4020-b46f-6aac1fbcf8cd tempest-GroupsTest-549040960 None] Created volume successfully. Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Flow 'volume_create_manager' (bb4cd528-d082-4a3d-990e-1ee7e3f637b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a4c890-54ea-4273-9150-3b3b77371e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43a4c890-54ea-4273-9150-3b3b77371e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-790587367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c24943a0-d273-4e70-97d2-e0a9e016b807,host='devstack@QuobyteHD#QuobyteHD',id=f9b7a139-a950-48dc-8900-e5bc1386d08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf9b8c7da784c3d8455343ff3406cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:06Z,use_quota=True,user_id='befb69038e82480e894cee137c3c1339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c391b8c2-4c64-44d0-8758-c7f72ecf73ba),volume_type_id=c391b8c2-4c64-44d0-8758-c7f72ecf73ba)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78f81af-3ccc-4926-8c1b-26b41d5b9d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e78f81af-3ccc-4926-8c1b-26b41d5b9d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a788ea-638b-4422-9215-dd93b5617eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a788ea-638b-4422-9215-dd93b5617eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b7a139-a950-48dc-8900-e5bc1386d08a', 'volume_name': 'volume-f9b7a139-a950-48dc-8900-e5bc1386d08a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864e4ae1-f87f-4d42-9544-9edc2b9f90ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864e4ae1-f87f-4d42-9544-9edc2b9f90ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ce5c8e-ec51-42ef-aa12-d8350e7ebacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Volume f9b7a139-a950-48dc-8900-e5bc1386d08a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b7a139-a950-48dc-8900-e5bc1386d08a', 'volume_size': 1} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c24943a0-d273-4e70-97d2-e0a9e016b807,created_at=2026-09-09T14:48:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-790587367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c24943a0-d273-4e70-97d2-e0a9e016b807,host='devstack@QuobyteHD#QuobyteHD',id=f9b7a139-a950-48dc-8900-e5bc1386d08a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdf9b8c7da784c3d8455343ff3406cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:06Z,use_quota=True,user_id='befb69038e82480e894cee137c3c1339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c391b8c2-4c64-44d0-8758-c7f72ecf73ba),volume_type_id=c391b8c2-4c64-44d0-8758-c7f72ecf73ba)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Creating volume f9b7a139-a950-48dc-8900-e5bc1386d08a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:48:06 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:06 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a 1073741824 Sep 09 16:48:06 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:06 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a 1073741824" returned: 0 in 0.515s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:06 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a Sep 09 16:48:06 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:07 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a" returned: 0 in 0.437s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:48:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59ce5c8e-ec51-42ef-aa12-d8350e7ebacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b7a139-a950-48dc-8900-e5bc1386d08a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d91e056-eb60-45fd-ba2e-52d1940e0215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Volume volume-f9b7a139-a950-48dc-8900-e5bc1386d08a (f9b7a139-a950-48dc-8900-e5bc1386d08a): created successfully Sep 09 16:48:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d91e056-eb60-45fd-ba2e-52d1940e0215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Flow 'volume_create_manager' (bb4cd528-d082-4a3d-990e-1ee7e3f637b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-937fde22-379e-4aaf-b7b2-50ba6f5ab177 tempest-GroupsTest-549040960 None] Created volume successfully. Sep 09 16:48:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3a77843a-dbde-4da9-951f-a84f64404a3f tempest-GroupsTest-549040960 None] Update group completed successfully. Sep 09 16:48:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cbc2e95a-04fc-4ff5-99a4-02e84b2b9ad9 tempest-GroupsTest-549040960 None] Update group completed successfully. Sep 09 16:48:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Acquiring lock "cinder-quobyte-7670bff2-985e-4d98-8089-773c53cf2200" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Lock "cinder-quobyte-7670bff2-985e-4d98-8089-773c53cf2200" acquired by "delete_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddc27e6-4e12-4cab-bb9c-62a824f0245b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:12 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200 Sep 09 16:48:12 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:13 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Flow 'volume_create_manager' (9a1ce8c6-f2ad-44f3-a708-929859a0becb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3f2672-09ec-4b94-8c84-3feac7b649ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200" returned: 0 in 0.647s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3f2672-09ec-4b94-8c84-3feac7b649ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1091127372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2825f2c8-2d1f-4c42-b428-6f85e34edbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5edb187726748ed8b501812cd6a171c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:13Z,use_quota=True,user_id='b7873afcfc26477dadda92240cf68d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c986e5bf-fe31-4a8f-810c-8a83ec84e3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:13 devstack sudo[92095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200 Sep 09 16:48:13 devstack sudo[92095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c986e5bf-fe31-4a8f-810c-8a83ec84e3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab0e92c-3602-41b6-8f42-af8759f1233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ab0e92c-3602-41b6-8f42-af8759f1233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2825f2c8-2d1f-4c42-b428-6f85e34edbce', 'volume_name': 'volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349f0d42-2c24-4899-826c-517136f203e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349f0d42-2c24-4899-826c-517136f203e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282ae066-530c-474e-b594-fd68ab80b03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Volume 2825f2c8-2d1f-4c42-b428-6f85e34edbce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce', 'volume_size': 1} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1091127372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2825f2c8-2d1f-4c42-b428-6f85e34edbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5edb187726748ed8b501812cd6a171c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:13Z,use_quota=True,user_id='b7873afcfc26477dadda92240cf68d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Creating volume 2825f2c8-2d1f-4c42-b428-6f85e34edbce {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:48:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:13 devstack sudo[92097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce 1073741824 Sep 09 16:48:13 devstack sudo[92097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:13 devstack sudo[92095]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7670bff2-985e-4d98-8089-773c53cf2200" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Lock "cinder-quobyte-7670bff2-985e-4d98-8089-773c53cf2200" released by "delete_volume" :: held 0.998s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Acquiring lock "cinder-quobyte-f9b7a139-a950-48dc-8900-e5bc1386d08a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Lock "cinder-quobyte-f9b7a139-a950-48dc-8900-e5bc1386d08a" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[addef178-5577-4d09-ac8b-e724baa706e9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:13 devstack sudo[92103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a Sep 09 16:48:13 devstack sudo[92103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:13 devstack sudo[92097]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce 1073741824" returned: 0 in 0.597s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:13 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce Sep 09 16:48:13 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:13 devstack sudo[92103]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a" returned: 0 in 0.506s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:13 devstack sudo[92111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a Sep 09 16:48:13 devstack sudo[92111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:14 devstack sudo[92111]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9b7a139-a950-48dc-8900-e5bc1386d08a" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Lock "cinder-quobyte-f9b7a139-a950-48dc-8900-e5bc1386d08a" released by "delete_volume" :: held 0.964s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:14 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce" returned: 0 in 0.565s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282ae066-530c-474e-b594-fd68ab80b03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf4e0c5-d9f4-4051-8a60-ca4ce2dc12d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Volume volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce (2825f2c8-2d1f-4c42-b428-6f85e34edbce): created successfully Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bf4e0c5-d9f4-4051-8a60-ca4ce2dc12d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Flow 'volume_create_manager' (9a1ce8c6-f2ad-44f3-a708-929859a0becb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6feb8d22-b7e4-40ab-b8dc-a21cd49a45e2 tempest-AttachVolumeTestJSON-953561773 None] Created volume successfully. Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Created reservations ['549c9428-16ae-42d7-a116-6b489625f152'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:14 devstack cinder-volume[87498]: WARNING cinder.quota [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-587836974 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-587836974, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:48:14 devstack cinder-volume[87498]: WARNING cinder.quota [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-587836974 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-587836974, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Created reservations ['2a3bf82e-b496-41da-a4b8-461e320ec74c', '17474a1f-8866-4663-8a56-977822ebfb84', 'b97595f1-5d0b-4bfa-a9b6-1f1b0a87dfe9', '24b8861f-498c-44d1-af2e-ef43330e9cb6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Created reservations ['b7eae142-a339-4ced-ada7-9d382202ba5f', '4adc28b9-a68d-4dbc-9f39-d9c2d0a4bc87', 'eb434790-de0c-4f6f-b445-f3737f150cff', 'c2903f22-27e8-4723-8e60-5b954c976d68'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:14 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:48:14 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:15 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.400s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:15 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-94ec6fcd-8dfa-4e4b-81cf-145071a2ca52 tempest-GroupsTest-549040960 None] Delete group completed successfully. Sep 09 16:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0b5632e7-aedd-495d-aea6-3e0c86151cc0 req-9dbd2469-3688-4ba1-a192-f00ba5d3d241 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0b5632e7-aedd-495d-aea6-3e0c86151cc0 req-9dbd2469-3688-4ba1-a192-f00ba5d3d241 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0b5632e7-aedd-495d-aea6-3e0c86151cc0 req-9dbd2469-3688-4ba1-a192-f00ba5d3d241 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-0b5632e7-aedd-495d-aea6-3e0c86151cc0 req-9dbd2469-3688-4ba1-a192-f00ba5d3d241 tempest-AttachVolumeTestJSON-953561773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fc85a15-25e2-4c9b-993b-854c86cf63e5', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:48:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-0b5632e7-aedd-495d-aea6-3e0c86151cc0 req-9dbd2469-3688-4ba1-a192-f00ba5d3d241 tempest-AttachVolumeTestJSON-953561773 None] attachment_update completed successfully. Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=73,cinder:UPDATE=80,cinder:DELETE=4,cinder:INSERT=16 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=83,cinder:SELECT=91,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Flow 'volume_create_manager' (623caa79-ecbc-498f-a59c-a6eb78f50a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac756f9-02bf-4ba1-b563-2a02a518e629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac756f9-02bf-4ba1-b563-2a02a518e629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1756650529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a34332f-3b28-4105-a0fa-ebc3cc711866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5edb187726748ed8b501812cd6a171c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:19Z,use_quota=True,user_id='b7873afcfc26477dadda92240cf68d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac49fc6-787c-4f55-acf8-8d50d5d93616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aac49fc6-787c-4f55-acf8-8d50d5d93616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2305c3ea-0321-4c39-ba1e-53d1dc329875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2305c3ea-0321-4c39-ba1e-53d1dc329875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a34332f-3b28-4105-a0fa-ebc3cc711866', 'volume_name': 'volume-1a34332f-3b28-4105-a0fa-ebc3cc711866', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37eb52b-f0a2-4278-928b-da96e5fbf512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37eb52b-f0a2-4278-928b-da96e5fbf512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1837c733-a017-4208-a148-6929c30abf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Volume 1a34332f-3b28-4105-a0fa-ebc3cc711866: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a34332f-3b28-4105-a0fa-ebc3cc711866', 'volume_size': 1} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1756650529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a34332f-3b28-4105-a0fa-ebc3cc711866,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5edb187726748ed8b501812cd6a171c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:19Z,use_quota=True,user_id='b7873afcfc26477dadda92240cf68d09',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Creating volume 1a34332f-3b28-4105-a0fa-ebc3cc711866 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:48:19 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:48:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:19 devstack sudo[92554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866 1073741824 Sep 09 16:48:19 devstack sudo[92554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:20 devstack sudo[92554]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866 1073741824" returned: 0 in 0.581s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:20 devstack sudo[92560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866 Sep 09 16:48:20 devstack sudo[92560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:20 devstack sudo[92560]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:48:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1837c733-a017-4208-a148-6929c30abf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a34332f-3b28-4105-a0fa-ebc3cc711866', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776d846e-85d9-47e1-a027-52fa5f42c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Volume volume-1a34332f-3b28-4105-a0fa-ebc3cc711866 (1a34332f-3b28-4105-a0fa-ebc3cc711866): created successfully Sep 09 16:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (776d846e-85d9-47e1-a027-52fa5f42c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Flow 'volume_create_manager' (623caa79-ecbc-498f-a59c-a6eb78f50a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-772c9694-71f2-49c7-ad00-9094ffbfc94c tempest-AttachVolumeTestJSON-953561773 None] Created volume successfully. Sep 09 16:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-65056969-dfd5-4267-b5a0-a1502efc14d1 req-3030673b-a52e-4cb5-b968-a019e45b7263 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-65056969-dfd5-4267-b5a0-a1502efc14d1 req-3030673b-a52e-4cb5-b968-a019e45b7263 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-65056969-dfd5-4267-b5a0-a1502efc14d1 req-3030673b-a52e-4cb5-b968-a019e45b7263 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-65056969-dfd5-4267-b5a0-a1502efc14d1 req-3030673b-a52e-4cb5-b968-a019e45b7263 tempest-AttachVolumeTestJSON-953561773 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-1a34332f-3b28-4105-a0fa-ebc3cc711866', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '698bb61e-51fd-4dd9-9a6b-fecdb193cee6', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:48:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-65056969-dfd5-4267-b5a0-a1502efc14d1 req-3030673b-a52e-4cb5-b968-a019e45b7263 tempest-AttachVolumeTestJSON-953561773 None] attachment_update completed successfully. Sep 09 16:48:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-b8153fc1-01a6-4391-a3fb-5f3251dfb803 req-91062a09-72c4-4eb4-9a9e-045e2e647492 tempest-AttachVolumeTestJSON-953561773 None] Terminate volume connection completed successfully. Sep 09 16:48:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-b8153fc1-01a6-4391-a3fb-5f3251dfb803 req-91062a09-72c4-4eb4-9a9e-045e2e647492 tempest-AttachVolumeTestJSON-953561773 None] Deleting attachment 1fc85a15-25e2-4c9b-993b-854c86cf63e5. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Flow 'volume_create_manager' (7640caf4-231a-492b-939e-60d5e1b6370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858c65c7-03f5-4f95-a394-7f2f83a4bdaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858c65c7-03f5-4f95-a394-7f2f83a4bdaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2044752177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac67e71-63c4-4523-83e6-fa092e782419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e4de6cc0b41bdab696ed32e8fa69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:26Z,use_quota=True,user_id='1c18863140634c5c8071e338a955e73f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef23e50e-937a-47a8-aa81-eb2ce597af8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef23e50e-937a-47a8-aa81-eb2ce597af8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d69dda-72e8-4ead-9753-dcd0f4133f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d69dda-72e8-4ead-9753-dcd0f4133f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac67e71-63c4-4523-83e6-fa092e782419', 'volume_name': 'volume-0ac67e71-63c4-4523-83e6-fa092e782419', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f8d7e3-36f9-45ca-a5a8-6b02c23b4ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f8d7e3-36f9-45ca-a5a8-6b02c23b4ce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da500aa0-dc2a-4621-834b-ad8903ea2513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Volume 0ac67e71-63c4-4523-83e6-fa092e782419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac67e71-63c4-4523-83e6-fa092e782419', 'volume_size': 1} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2044752177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac67e71-63c4-4523-83e6-fa092e782419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e4de6cc0b41bdab696ed32e8fa69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:26Z,use_quota=True,user_id='1c18863140634c5c8071e338a955e73f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Creating volume 0ac67e71-63c4-4523-83e6-fa092e782419 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:48:26 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:26 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419 1073741824 Sep 09 16:48:26 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:26 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419 1073741824" returned: 0 in 0.677s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:26 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419 Sep 09 16:48:26 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:27 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419" returned: 0 in 0.325s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:48:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da500aa0-dc2a-4621-834b-ad8903ea2513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac67e71-63c4-4523-83e6-fa092e782419', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974ea534-9f04-42e9-bef2-c30c1561c74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Volume volume-0ac67e71-63c4-4523-83e6-fa092e782419 (0ac67e71-63c4-4523-83e6-fa092e782419): created successfully Sep 09 16:48:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (974ea534-9f04-42e9-bef2-c30c1561c74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Flow 'volume_create_manager' (7640caf4-231a-492b-939e-60d5e1b6370a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9e2d3b9a-89f5-4ef8-bbf4-78823b9f4f1b tempest-VolumeQuotasAdminTestJSON-1865794270 None] Created volume successfully. Sep 09 16:48:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-9deded50-7225-4e48-b086-d620904d2574 req-85616de7-b7f4-4f2a-9121-608f8d9f688c tempest-AttachVolumeTestJSON-953561773 None] Terminate volume connection completed successfully. Sep 09 16:48:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-9deded50-7225-4e48-b086-d620904d2574 req-85616de7-b7f4-4f2a-9121-608f8d9f688c tempest-AttachVolumeTestJSON-953561773 None] Deleting attachment 698bb61e-51fd-4dd9-9a6b-fecdb193cee6. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:48:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Acquiring lock "cinder-0ac67e71-63c4-4523-83e6-fa092e782419-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "cinder-0ac67e71-63c4-4523-83e6-fa092e782419-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Acquiring lock "cinder-quobyte-0ac67e71-63c4-4523-83e6-fa092e782419" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "cinder-quobyte-0ac67e71-63c4-4523-83e6-fa092e782419" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9b35b1-d985-46a7-9ece-be947e4099e6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:28 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419 Sep 09 16:48:28 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:28 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419" returned: 0 in 0.445s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:28 devstack sudo[92637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419 Sep 09 16:48:28 devstack sudo[92637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:29 devstack sudo[92637]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0ac67e71-63c4-4523-83e6-fa092e782419" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "cinder-quobyte-0ac67e71-63c4-4523-83e6-fa092e782419" released by "delete_volume" :: held 0.911s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Created reservations ['ee941ef0-9d20-4a5b-8d75-b787325fbaa2', '9d4c28ee-d88e-40f7-8b48-03806d5c009f', '016b35de-4cc3-433f-bbf5-ebdf3822d441', '5fbaeaf0-3e9a-4f74-a440-8aac13b5b849'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:29 devstack sudo[92656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:48:29 devstack sudo[92656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:29 devstack sudo[92656]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Deleted volume successfully. Sep 09 16:48:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d4075f-2a77-4239-a0a6-166e10adc693 tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "cinder-0ac67e71-63c4-4523-83e6-fa092e782419-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Flow 'volume_create_manager' (dedc37d0-9bc6-4260-bfb9-608a72b35538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50147582-431e-4616-bd1c-8027407dff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50147582-431e-4616-bd1c-8027407dff5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1070909578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664427a0-e98a-4424-8815-b3ecea3f76ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e4de6cc0b41bdab696ed32e8fa69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:31Z,use_quota=True,user_id='1c18863140634c5c8071e338a955e73f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65797f01-be58-4e97-aa9e-3f53ee0fea3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65797f01-be58-4e97-aa9e-3f53ee0fea3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a22c8c1-5447-4187-a1de-94ceeeee6991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a22c8c1-5447-4187-a1de-94ceeeee6991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '664427a0-e98a-4424-8815-b3ecea3f76ca', 'volume_name': 'volume-664427a0-e98a-4424-8815-b3ecea3f76ca', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7057c33a-c2f9-4133-b2ab-aa11a625f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7057c33a-c2f9-4133-b2ab-aa11a625f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb503b3-6e98-46e0-9e6a-d4f1c8e850af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Volume 664427a0-e98a-4424-8815-b3ecea3f76ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-664427a0-e98a-4424-8815-b3ecea3f76ca', 'volume_size': 1} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1070909578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=664427a0-e98a-4424-8815-b3ecea3f76ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a7e4de6cc0b41bdab696ed32e8fa69a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:31Z,use_quota=True,user_id='1c18863140634c5c8071e338a955e73f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Creating volume 664427a0-e98a-4424-8815-b3ecea3f76ca {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:48:31 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:48:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:31 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca 1073741824 Sep 09 16:48:31 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:32 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca 1073741824" returned: 0 in 0.612s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:32 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca Sep 09 16:48:32 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:32 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:48:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb503b3-6e98-46e0-9e6a-d4f1c8e850af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-664427a0-e98a-4424-8815-b3ecea3f76ca', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a2e75b-26e2-4bc3-9c09-d65fa4f4d29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Volume volume-664427a0-e98a-4424-8815-b3ecea3f76ca (664427a0-e98a-4424-8815-b3ecea3f76ca): created successfully Sep 09 16:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01a2e75b-26e2-4bc3-9c09-d65fa4f4d29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Flow 'volume_create_manager' (dedc37d0-9bc6-4260-bfb9-608a72b35538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9968a301-b385-4694-be4c-425dbc4d7a3c tempest-VolumeQuotasAdminTestJSON-1865794270 None] Created volume successfully. Sep 09 16:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "cinder-1a34332f-3b28-4105-a0fa-ebc3cc711866-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-1a34332f-3b28-4105-a0fa-ebc3cc711866-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "cinder-quobyte-1a34332f-3b28-4105-a0fa-ebc3cc711866" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-quobyte-1a34332f-3b28-4105-a0fa-ebc3cc711866" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7416a5e2-b754-4616-9cbd-c036ce91d6ba]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:33 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866 Sep 09 16:48:33 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:33 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866" returned: 0 in 0.452s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:33 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866 Sep 09 16:48:33 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:34 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1a34332f-3b28-4105-a0fa-ebc3cc711866" returned: 0 in 0.492s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-quobyte-1a34332f-3b28-4105-a0fa-ebc3cc711866" released by "delete_volume" :: held 1.021s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Created reservations ['b9d4e730-781c-4efd-bb55-530ee12759c0', '3ee255ef-745d-47c9-93fb-c1ba49c3d5a2', '540b53a5-831a-4c43-bd2a-62be9c2e4f79', '799170fb-36a0-48a0-b3fe-e41c0907c424'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:34 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:48:34 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:34 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Deleted volume successfully. Sep 09 16:48:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b806e8a2-08bc-4169-8884-d151dad71588 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-1a34332f-3b28-4105-a0fa-ebc3cc711866-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e59ad3d7-1858-4235-b8e3-cb1edd570ad7 tempest-VolumeQuotasAdminTestJSON-74195562 None] Transfer volume completed successfully. Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Acquiring lock "cinder-664427a0-e98a-4424-8815-b3ecea3f76ca-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Lock "cinder-664427a0-e98a-4424-8815-b3ecea3f76ca-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Acquiring lock "cinder-quobyte-664427a0-e98a-4424-8815-b3ecea3f76ca" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Lock "cinder-quobyte-664427a0-e98a-4424-8815-b3ecea3f76ca" acquired by "delete_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "cinder-2825f2c8-2d1f-4c42-b428-6f85e34edbce-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5062468e-7fb9-4db8-8129-491277171b9e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-2825f2c8-2d1f-4c42-b428-6f85e34edbce-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "cinder-quobyte-2825f2c8-2d1f-4c42-b428-6f85e34edbce" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-quobyte-2825f2c8-2d1f-4c42-b428-6f85e34edbce" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3f2651-a619-4f33-a99b-44ef7a6adb00]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:35 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca Sep 09 16:48:35 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:35 devstack sudo[92692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce Sep 09 16:48:35 devstack sudo[92692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:35 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca" returned: 0 in 0.417s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:35 devstack sudo[92699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca Sep 09 16:48:35 devstack sudo[92699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:35 devstack sudo[92692]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:35 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce Sep 09 16:48:35 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:36 devstack sudo[92699]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-664427a0-e98a-4424-8815-b3ecea3f76ca" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Lock "cinder-quobyte-664427a0-e98a-4424-8815-b3ecea3f76ca" released by "delete_volume" :: held 0.753s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Created reservations ['f5ee7d53-4c35-42ac-b2ca-ca93d6548375', '706a83e9-1bb7-4a6c-b1f0-c300cab0babc', '4b80a190-0515-4e6e-afa1-1c96b260106e', 'bd5f4c1e-e081-414f-909f-22c1f18655fd'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:36 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2825f2c8-2d1f-4c42-b428-6f85e34edbce" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-quobyte-2825f2c8-2d1f-4c42-b428-6f85e34edbce" released by "delete_volume" :: held 0.761s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:36 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:48:36 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Created reservations ['805f0d0b-f102-4337-bfbe-69286af1e35f', '0f0c09b7-ec5c-42de-a58d-2e136e382517', 'e2975ebb-fd3f-4002-a8b5-291afa25633b', 'e38046c5-7714-4cd5-868c-79365f7a0bb5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:36 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:48:36 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:36 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Deleted volume successfully. Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f67e1948-5edd-4576-9c4e-83be9408c8de tempest-VolumeQuotasAdminTestJSON-1322019338 None] Lock "cinder-664427a0-e98a-4424-8815-b3ecea3f76ca-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "cinder-33da5416-edff-4f40-990e-2256d714c9e0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-33da5416-edff-4f40-990e-2256d714c9e0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "cinder-quobyte-33da5416-edff-4f40-990e-2256d714c9e0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:36 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.427s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-quobyte-33da5416-edff-4f40-990e-2256d714c9e0" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Deleted volume successfully. Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a657906f-4b00-4ea7-a405-6f36a67b3800]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca21755b-0753-4a9e-be8a-0fe38a945020 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-2825f2c8-2d1f-4c42-b428-6f85e34edbce-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:37 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0 Sep 09 16:48:37 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:37 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0" returned: 0 in 0.425s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:37 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0 Sep 09 16:48:37 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:37 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-33da5416-edff-4f40-990e-2256d714c9e0" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-quobyte-33da5416-edff-4f40-990e-2256d714c9e0" released by "delete_volume" :: held 0.765s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Created reservations ['e654e052-3e8f-4608-ba6d-db88e25881d0', '832b897f-1787-4699-8718-fce9a4ffaed1', 'aa4b7903-3435-48d3-9c23-1cd362b4bf9b', 'd857f115-512f-4dbf-810c-e818f9dd7aa3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:37 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:48:37 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:38 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:38 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Deleted volume successfully. Sep 09 16:48:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ffd93600-3b6f-4276-9b39-67490ed71cc8 tempest-AttachVolumeTestJSON-953561773 None] Lock "cinder-33da5416-edff-4f40-990e-2256d714c9e0-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:44 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:48:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:45 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:48:45 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:45 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.458s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:48:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:48:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Flow 'volume_create_manager' (08195d89-93b8-4a32-9a4b-bbbc5b1ae3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2671960-3c7b-4fb8-ad8e-f4007fc6ef80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2671960-3c7b-4fb8-ad8e-f4007fc6ef80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1211996254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2041356e-697f-4b2e-9548-1e4ee30c185c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca013df0fe3c4a348c1c3b304884f24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:47Z,use_quota=True,user_id='ba538276283247a2b67502ef29429f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee73c1e5-1314-4f99-80bd-92004d8a9b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee73c1e5-1314-4f99-80bd-92004d8a9b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a786d51a-b091-4f30-89a3-9846db3e9218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a786d51a-b091-4f30-89a3-9846db3e9218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2041356e-697f-4b2e-9548-1e4ee30c185c', 'volume_name': 'volume-2041356e-697f-4b2e-9548-1e4ee30c185c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d38343-d7bd-4aea-8bca-8df00859616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d38343-d7bd-4aea-8bca-8df00859616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ab0f4d-4b22-40cb-90f5-d900ebaa46b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Volume 2041356e-697f-4b2e-9548-1e4ee30c185c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2041356e-697f-4b2e-9548-1e4ee30c185c', 'volume_size': 1} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1211996254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2041356e-697f-4b2e-9548-1e4ee30c185c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca013df0fe3c4a348c1c3b304884f24b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:47Z,use_quota=True,user_id='ba538276283247a2b67502ef29429f9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Creating volume 2041356e-697f-4b2e-9548-1e4ee30c185c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:48:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:47 devstack sudo[92836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c 1073741824 Sep 09 16:48:47 devstack sudo[92836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:47 devstack sudo[92836]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c 1073741824" returned: 0 in 0.629s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:48 devstack sudo[92844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c Sep 09 16:48:48 devstack sudo[92844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:48 devstack sudo[92844]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c" returned: 0 in 0.645s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] <== create_volume: return (1336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:48:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.341s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48ab0f4d-4b22-40cb-90f5-d900ebaa46b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2041356e-697f-4b2e-9548-1e4ee30c185c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b851c96-8da5-463c-acfe-8d15552c7b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Volume volume-2041356e-697f-4b2e-9548-1e4ee30c185c (2041356e-697f-4b2e-9548-1e4ee30c185c): created successfully Sep 09 16:48:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b851c96-8da5-463c-acfe-8d15552c7b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Flow 'volume_create_manager' (08195d89-93b8-4a32-9a4b-bbbc5b1ae3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c0b6e284-27b8-4718-b7d9-5cda92b87364 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Created volume successfully. Sep 09 16:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Creating offline snapshot 497bc7ae-e321-4542-9b14-fe9693990a8b of volume 2041356e-697f-4b2e-9548-1e4ee30c185c {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:48:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c01130-fbd1-4d54-b8bc-60d69a8a909d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:50 devstack sudo[92870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c Sep 09 16:48:50 devstack sudo[92870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:50 devstack sudo[92870]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c" returned: 0 in 0.764s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:50 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b 1G Sep 09 16:48:50 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:51 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b 1G" returned: 0 in 0.876s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2041356e-697f-4b2e-9548-1e4ee30c185c -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:51 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2041356e-697f-4b2e-9548-1e4ee30c185c -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b Sep 09 16:48:51 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4efd0bb5-bdc1-45df-befc-6091d007d689 tempest-GroupSnapshotsTest-53368159 None] Group tempest-GroupSnapshotsTest-Group-1680648084: creating Sep 09 16:48:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4efd0bb5-bdc1-45df-befc-6091d007d689 tempest-GroupSnapshotsTest-53368159 None] Group tempest-GroupSnapshotsTest-Group-1680648084: created successfully Sep 09 16:48:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4efd0bb5-bdc1-45df-befc-6091d007d689 tempest-GroupSnapshotsTest-53368159 None] Create group completed successfully. Sep 09 16:48:51 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2041356e-697f-4b2e-9548-1e4ee30c185c -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:51 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b is being set with open permissions: ugo+rw Sep 09 16:48:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:51 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b Sep 09 16:48:51 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:52 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:52 devstack sudo[92894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.info Sep 09 16:48:52 devstack sudo[92894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:52 devstack sudo[92894]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.info" returned: 0 in 0.289s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:52 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.info is being set with open permissions: ugo+rw Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:52 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.info Sep 09 16:48:52 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Acquiring lock "cinder-6da34a62-fcf5-494b-a860-9e47fd021e89-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Lock "cinder-6da34a62-fcf5-494b-a860-9e47fd021e89-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:52 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.info" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.034s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Acquiring lock "cinder-quobyte-6da34a62-fcf5-494b-a860-9e47fd021e89" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Lock "cinder-quobyte-6da34a62-fcf5-494b-a860-9e47fd021e89" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c3e0ac01-b8aa-4502-a0d0-6f1dc531418c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Create snapshot completed successfully Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdccc98-a811-4575-ac44-e479aab14eb1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:53 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89 Sep 09 16:48:53 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Flow 'volume_create_manager' (3737c756-5b35-4134-9abe-741fd19e29c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09fb309-0ffa-43e3-ae8e-fcff8a63ae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d09fb309-0ffa-43e3-ae8e-fcff8a63ae5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-458236185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8f45364-886b-40e1-a537-e21037a680f7,host='devstack@QuobyteHD#QuobyteHD',id=8d77a630-d1dd-4b20-875c-d18d8fd507e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f5ecad09b84b22a4b30fb35c1185a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:53Z,use_quota=True,user_id='562059af28f54d68837405a940cb4d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43d6708d-c48d-4570-acf7-cc80cd53ed1b),volume_type_id=43d6708d-c48d-4570-acf7-cc80cd53ed1b)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5bd740-0dfb-4845-a7e2-60b84da178ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df5bd740-0dfb-4845-a7e2-60b84da178ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21912167-6167-488a-bfac-49a7aae6e6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21912167-6167-488a-bfac-49a7aae6e6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d77a630-d1dd-4b20-875c-d18d8fd507e1', 'volume_name': 'volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a23423a-8fdf-4a1c-aca6-62675d4717aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a23423a-8fdf-4a1c-aca6-62675d4717aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6e856c-1ab1-40b6-ae49-d4b57734c1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Volume 8d77a630-d1dd-4b20-875c-d18d8fd507e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1', 'volume_size': 1} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f8f45364-886b-40e1-a537-e21037a680f7,created_at=2026-09-09T14:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-458236185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f8f45364-886b-40e1-a537-e21037a680f7,host='devstack@QuobyteHD#QuobyteHD',id=8d77a630-d1dd-4b20-875c-d18d8fd507e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f5ecad09b84b22a4b30fb35c1185a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:48:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:48:53Z,use_quota=True,user_id='562059af28f54d68837405a940cb4d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(43d6708d-c48d-4570-acf7-cc80cd53ed1b),volume_type_id=43d6708d-c48d-4570-acf7-cc80cd53ed1b)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Creating volume 8d77a630-d1dd-4b20-875c-d18d8fd507e1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:48:53 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:53 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89" returned: 0 in 0.604s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:53 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 1073741824 Sep 09 16:48:53 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:53 devstack sudo[92907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89 Sep 09 16:48:53 devstack sudo[92907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:53 devstack sudo[92907]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6da34a62-fcf5-494b-a860-9e47fd021e89" returned: 0 in 0.284s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Lock "cinder-quobyte-6da34a62-fcf5-494b-a860-9e47fd021e89" released by "delete_volume" :: held 0.944s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Created reservations ['d5783b1f-694d-4f3a-8b80-5dd67bbbb51a', '7e6660fe-5229-480b-a1c7-71d92aa4843c', '0267cf5c-a3d5-4788-a85b-d93b6e178a05', '01b7f4ff-c02a-4276-8260-178043cbdcb8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:54 devstack sudo[92915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:48:54 devstack sudo[92915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:54 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 1073741824" returned: 0 in 0.587s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:54 devstack sudo[92917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 Sep 09 16:48:54 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:54 devstack sudo[92915]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Deleted volume successfully. Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-86d8aba3-5818-4d84-a549-92cd64cba40e tempest-AttachVolumeShelveTestJSON-744334827 None] Lock "cinder-6da34a62-fcf5-494b-a860-9e47fd021e89-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:54 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad6e856c-1ab1-40b6-ae49-d4b57734c1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ad64b4-1a91-45e1-8139-adc143e7cc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:48:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Volume volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 (8d77a630-d1dd-4b20-875c-d18d8fd507e1): created successfully Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33ad64b4-1a91-45e1-8139-adc143e7cc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Flow 'volume_create_manager' (3737c756-5b35-4134-9abe-741fd19e29c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:48:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ec1f26f4-3cdf-4629-a63c-1f5eac2dbfd8 tempest-GroupSnapshotsTest-53368159 None] Created volume successfully. Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Acquiring lock "cinder-497bc7ae-e321-4542-9b14-fe9693990a8b-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "cinder-497bc7ae-e321-4542-9b14-fe9693990a8b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Acquiring lock "cinder-quobyte-2041356e-697f-4b2e-9548-1e4ee30c185c" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "cinder-quobyte-2041356e-697f-4b2e-9548-1e4ee30c185c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Acquiring lock "cinder-quobyte-497bc7ae-e321-4542-9b14-fe9693990a8b" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "cinder-quobyte-497bc7ae-e321-4542-9b14-fe9693990a8b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Deleting offline snapshot 497bc7ae-e321-4542-9b14-fe9693990a8b of volume 2041356e-697f-4b2e-9548-1e4ee30c185c {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] snapshot_file for this snap is: volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f04c527-b4d8-4e0f-9abf-f1135f55d223]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:54 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b Sep 09 16:48:54 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] GroupSnapshot aea77d50-d132-4650-a814-a54194064e26: creating. Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Group snapshot aea77d50-d132-4650-a814-a54194064e26: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Creating offline snapshot 7125c117-e3ca-4388-bd8a-6dae151f4a8e of volume 8d77a630-d1dd-4b20-875c-d18d8fd507e1 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce11281c-edd4-4243-9ca4-915a142913e7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:55 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b" returned: 0 in 0.426s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2041356e-697f-4b2e-9548-1e4ee30c185c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf214c3a-aa92-48ae-a0f0-8f5a4f439ade]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:55 devstack sudo[92927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 Sep 09 16:48:55 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:55 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c Sep 09 16:48:55 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:55 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1" returned: 0 in 0.417s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:55 devstack sudo[92937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e 1G Sep 09 16:48:55 devstack sudo[92937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:55 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c" returned: 0 in 0.409s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:55 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b Sep 09 16:48:55 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:55 devstack sudo[92937]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e 1G" returned: 0 in 0.420s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:55 devstack sudo[92948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e Sep 09 16:48:55 devstack sudo[92948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:56 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:56 devstack sudo[92950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b Sep 09 16:48:56 devstack sudo[92950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:56 devstack sudo[92948]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:56 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:56 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e Sep 09 16:48:56 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:56 devstack sudo[92950]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c.497bc7ae-e321-4542-9b14-fe9693990a8b" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "cinder-quobyte-497bc7ae-e321-4542-9b14-fe9693990a8b" released by "_delete_snapshot" :: held 1.756s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "cinder-quobyte-2041356e-697f-4b2e-9548-1e4ee30c185c" released by "delete_snapshot" :: held 1.783s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Created reservations ['b16eac8c-b00e-455d-820a-f6ccb91f07e3', '91a0ad1d-a30e-4fa2-b08c-31500f335d40', 'ee6356e7-d672-40d5-9a25-b7fe7cc9aa3b', '8f124803-1fa8-4670-865d-5eba29d97811'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Delete snapshot completed successfully. Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f9cd97b-f803-470c-857e-a2344bb18108 tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "cinder-497bc7ae-e321-4542-9b14-fe9693990a8b-delete_snapshot" released by "delete_snapshot" :: held 1.978s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:56 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:56 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.info Sep 09 16:48:56 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Acquiring lock "cinder-2041356e-697f-4b2e-9548-1e4ee30c185c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "cinder-2041356e-697f-4b2e-9548-1e4ee30c185c-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:57 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.info" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:57 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Acquiring lock "cinder-quobyte-2041356e-697f-4b2e-9548-1e4ee30c185c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:57 devstack sudo[92965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.info Sep 09 16:48:57 devstack sudo[92965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "cinder-quobyte-2041356e-697f-4b2e-9548-1e4ee30c185c" acquired by "delete_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f50bf14-90ff-4ce5-9189-0f5ca14c9597]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:57 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c Sep 09 16:48:57 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:57 devstack sudo[92965]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.info" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:57 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3557420f-0380-4108-acf4-ed779638bb29 tempest-GroupSnapshotsTest-53368159 None] group_snapshot aea77d50-d132-4650-a814-a54194064e26: created successfully Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:57 devstack sudo[92974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c Sep 09 16:48:57 devstack sudo[92974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:57 devstack sudo[92974]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2041356e-697f-4b2e-9548-1e4ee30c185c" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "cinder-quobyte-2041356e-697f-4b2e-9548-1e4ee30c185c" released by "delete_volume" :: held 0.786s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:57 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Created reservations ['0b0118a1-59c7-4ec5-9c17-28f3e7e88d21', '5e8693d9-f211-48e2-8f6b-bc3e2b597ac0', 'ce1c2dd6-4e7d-4775-9a25-26509ea07440', '692c5de7-c11d-49e1-8a9f-cabffe8d1873'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:48:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:58 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:48:58 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:58 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:48:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Deleted volume successfully. Sep 09 16:48:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3c879afe-0e32-447c-8c37-cd23b33c242c tempest-VolumeSnapshotQuotasNegativeTestJSON-1813510495 None] Lock "cinder-2041356e-697f-4b2e-9548-1e4ee30c185c-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-7125c117-e3ca-4388-bd8a-6dae151f4a8e-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-7125c117-e3ca-4388-bd8a-6dae151f4a8e-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Creating volume 7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c from snapshot 7125c117-e3ca-4388-bd8a-6dae151f4a8e {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] snapshot: 7125c117-e3ca-4388-bd8a-6dae151f4a8e, volume: 7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fdc7c3-4a8d-408c-b893-e4428afb122c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:59 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e Sep 09 16:48:59 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:48:59 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e" returned: 0 in 0.576s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0dc357-3884-48c3-aef1-85753e20e621]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:48:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:48:59 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 Sep 09 16:48:59 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:00 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 16:49:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 16:49:00 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 16:49:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:00 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c Sep 09 16:49:00 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:05 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" returned: 0 in 5.679s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:05 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1, size 1024.00 MB, duration 5.68 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:49:05 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Converted 1024.00 MB image at 180.27 MB/s Sep 09 16:49:05 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:49:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:05 devstack sudo[93065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c Sep 09 16:49:05 devstack sudo[93065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:06 devstack sudo[93065]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" returned: 0 in 0.306s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" released by "_copy_volume_from_snapshot" :: held 7.091s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-7125c117-e3ca-4388-bd8a-6dae151f4a8e-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" released by "_create_volume_from_snapshot" :: held 7.198s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.220s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a8186500-d3c8-4c34-9644-f2f6e74abc79 tempest-GroupSnapshotsTest-53368159 None] Create group from source-snapshot-aea77d50-d132-4650-a814-a54194064e26 completed successfully. Sep 09 16:49:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[34be2deb-25fb-4323-9dc2-c8d4e0e9ce3a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:07 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c Sep 09 16:49:07 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:08 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" returned: 0 in 0.535s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:08 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c Sep 09 16:49:08 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:08 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-7becc4e2-a2e7-43b4-a1f5-4c0a63ecce0c" released by "delete_volume" :: held 0.952s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Created reservations ['acc674c9-0db0-4991-a936-18590f19d99e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:08 devstack cinder-volume[87498]: WARNING cinder.quota [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-715006178 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-715006178, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:49:08 devstack cinder-volume[87498]: WARNING cinder.quota [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-715006178 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-715006178, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Created reservations ['8f7631b8-a481-4348-be37-bb801ed4532d', '8650ef9a-65af-4cdd-91c1-10c79c49c27e', '2c766dc6-1526-4954-9b03-a0fb2187aaf5', '50896e1f-2103-46ac-94c3-690018e229e6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:08 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:49:08 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] group_snapshot aea77d50-d132-4650-a814-a54194064e26: deleting Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] group_snapshot aea77d50-d132-4650-a814-a54194064e26: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-8d77a630-d1dd-4b20-875c-d18d8fd507e1" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-8d77a630-d1dd-4b20-875c-d18d8fd507e1" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-7125c117-e3ca-4388-bd8a-6dae151f4a8e" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-7125c117-e3ca-4388-bd8a-6dae151f4a8e" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Deleting offline snapshot 7125c117-e3ca-4388-bd8a-6dae151f4a8e of volume 8d77a630-d1dd-4b20-875c-d18d8fd507e1 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:49:08 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] snapshot_file for this snap is: volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:49:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8e2d1942-7bae-493e-8523-b22b880ffaf9 tempest-GroupSnapshotsTest-53368159 None] Delete group completed successfully. Sep 09 16:49:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9c7b58-fa4e-4fb4-a8d7-c208740240b1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:09 devstack sudo[93083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e Sep 09 16:49:09 devstack sudo[93083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:09 devstack sudo[93083]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:49:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fd4f0d-8c08-405a-bfd2-5797afb203ba]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:09 devstack sudo[93088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 Sep 09 16:49:09 devstack sudo[93088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:10 devstack sudo[93088]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1" returned: 0 in 0.550s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:10 devstack sudo[93095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e Sep 09 16:49:10 devstack sudo[93095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:10 devstack sudo[93095]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:10 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e Sep 09 16:49:10 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:10 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1.7125c117-e3ca-4388-bd8a-6dae151f4a8e" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-7125c117-e3ca-4388-bd8a-6dae151f4a8e" released by "_delete_snapshot" :: held 1.871s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-8d77a630-d1dd-4b20-875c-d18d8fd507e1" released by "delete_snapshot" :: held 1.914s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:10 devstack cinder-volume[87498]: WARNING cinder.quota [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-715006178 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-715006178, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:49:10 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] Created reservations ['2b313d05-48be-473e-9dd2-a6caf1088391', '22097ec3-0f4d-4dd5-bb4e-e6671ea98ca0', '16a21473-1616-489f-8ccd-86f0c140c62f', 'be532deb-2051-4b3e-a039-a6f32513cb8a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c864ad09-6fe6-4138-9c0b-9387c5f1f2f4 tempest-GroupSnapshotsTest-53368159 None] group_snapshot aea77d50-d132-4650-a814-a54194064e26: deleted successfully Sep 09 16:49:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-8d77a630-d1dd-4b20-875c-d18d8fd507e1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-8d77a630-d1dd-4b20-875c-d18d8fd507e1" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d170f89a-d364-4c59-b516-5746f7d40cd3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:11 devstack sudo[93106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 Sep 09 16:49:11 devstack sudo[93106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:12 devstack sudo[93106]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1" returned: 0 in 0.611s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:12 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1 Sep 09 16:49:12 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:12 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8d77a630-d1dd-4b20-875c-d18d8fd507e1" returned: 0 in 0.517s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:49:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Flow 'volume_create_manager' (c290503d-7139-4b0d-ab37-fa7fd063d2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b29c476-fb8d-47cd-b434-bec9241245dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-8d77a630-d1dd-4b20-875c-d18d8fd507e1" released by "delete_volume" :: held 1.280s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b29c476-fb8d-47cd-b434-bec9241245dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1550481316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e12b49d-f852-4874-8dc0-4601add3c653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b1eea6f02041ebba5a746ce200419b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:13Z,use_quota=True,user_id='53cbc1618b4348d38e734a98fd27657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15761feb-f9ef-4ed7-b659-4a250ee3919e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15761feb-f9ef-4ed7-b659-4a250ee3919e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab4a92e-a5b4-44ec-b385-391a59c879ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab4a92e-a5b4-44ec-b385-391a59c879ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e12b49d-f852-4874-8dc0-4601add3c653', 'volume_name': 'volume-2e12b49d-f852-4874-8dc0-4601add3c653', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373190e3-ffd5-440b-aaac-dcc6671a434d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (373190e3-ffd5-440b-aaac-dcc6671a434d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06fcee0-9efb-4eb8-b42f-1be3c991cfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Volume 2e12b49d-f852-4874-8dc0-4601add3c653: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e12b49d-f852-4874-8dc0-4601add3c653', 'volume_size': 1} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1550481316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e12b49d-f852-4874-8dc0-4601add3c653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b1eea6f02041ebba5a746ce200419b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:13Z,use_quota=True,user_id='53cbc1618b4348d38e734a98fd27657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Creating volume 2e12b49d-f852-4874-8dc0-4601add3c653 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:49:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:13 devstack sudo[93115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653 1073741824 Sep 09 16:49:13 devstack sudo[93115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Flow 'volume_create_manager' (6dabfd8e-fbee-49d2-99d9-d35bfec769f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14787c4-909b-473f-9ad5-47ed78bed9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c14787c4-909b-473f-9ad5-47ed78bed9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-7448679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb50e16-1440-4b76-8838-7d65fc6d3654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d596e3cca7e48c8a2283390f228223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:13Z,use_quota=True,user_id='fb2ae948cd3647d9b34702529c7ae3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39635b2b-d1db-46ee-973c-02fa207e2755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39635b2b-d1db-46ee-973c-02fa207e2755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b892d897-c7f2-42ac-8de3-652ce34d80a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b892d897-c7f2-42ac-8de3-652ce34d80a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb50e16-1440-4b76-8838-7d65fc6d3654', 'volume_name': 'volume-ebb50e16-1440-4b76-8838-7d65fc6d3654', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7af16d-6e0c-4625-a411-14c7d3aef855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7af16d-6e0c-4625-a411-14c7d3aef855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4078a549-ce25-41d2-ae47-223ae1324b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Volume ebb50e16-1440-4b76-8838-7d65fc6d3654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb50e16-1440-4b76-8838-7d65fc6d3654', 'volume_size': 1} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Created reservations ['126b53bd-f6cd-4850-84d5-efb7cb3236e9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:13 devstack cinder-volume[87498]: WARNING cinder.db.api [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-715006178'] Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Created reservations ['686c7e32-7cbb-44dc-a8a5-cfe0ea0a69a2', 'e1522933-bf80-4387-afba-97681327065a', '0c73b65e-4c32-4307-9be8-6e634c68b5df', '9bb36a20-859a-4cfe-9a33-50f192c94865'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:13 devstack sudo[93120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:49:13 devstack sudo[93120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:13 devstack sudo[93115]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653 1073741824" returned: 0 in 0.548s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:13 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653 Sep 09 16:49:13 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:13 devstack sudo[93120]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:49:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-30a0f956-50a1-469b-a603-49e3827360d3 tempest-GroupSnapshotsTest-53368159 None] Delete group completed successfully. Sep 09 16:49:13 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.758s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-7448679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb50e16-1440-4b76-8838-7d65fc6d3654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d596e3cca7e48c8a2283390f228223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:13Z,use_quota=True,user_id='fb2ae948cd3647d9b34702529c7ae3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Creating volume ebb50e16-1440-4b76-8838-7d65fc6d3654 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:49:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:49:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:14 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 1073741824 Sep 09 16:49:14 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b06fcee0-9efb-4eb8-b42f-1be3c991cfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e12b49d-f852-4874-8dc0-4601add3c653', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8e9f39-3956-43d9-bd24-b8bcb8f88ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Volume volume-2e12b49d-f852-4874-8dc0-4601add3c653 (2e12b49d-f852-4874-8dc0-4601add3c653): created successfully Sep 09 16:49:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b8e9f39-3956-43d9-bd24-b8bcb8f88ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Flow 'volume_create_manager' (c290503d-7139-4b0d-ab37-fa7fd063d2b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b6e05df7-58da-40eb-9cbd-54b324d8b7f0 tempest-ServerActionsTestOtherA-40635085 None] Created volume successfully. Sep 09 16:49:14 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 1073741824" returned: 0 in 0.589s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:14 devstack sudo[93133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 Sep 09 16:49:14 devstack sudo[93133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-28bc3ef0-2853-47bb-95ac-1f6d24a9fa8c tempest-GroupSnapshotsTest-53368159 None] Group tempest-GroupSnapshotsTest-Group-1701628667: creating Sep 09 16:49:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-28bc3ef0-2853-47bb-95ac-1f6d24a9fa8c tempest-GroupSnapshotsTest-53368159 None] Group tempest-GroupSnapshotsTest-Group-1701628667: created successfully Sep 09 16:49:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-28bc3ef0-2853-47bb-95ac-1f6d24a9fa8c tempest-GroupSnapshotsTest-53368159 None] Create group completed successfully. Sep 09 16:49:14 devstack sudo[93133]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:49:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4078a549-ce25-41d2-ae47-223ae1324b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb50e16-1440-4b76-8838-7d65fc6d3654', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57df7672-c4ad-41ee-b687-485c9ef5716e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Volume volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 (ebb50e16-1440-4b76-8838-7d65fc6d3654): created successfully Sep 09 16:49:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57df7672-c4ad-41ee-b687-485c9ef5716e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Flow 'volume_create_manager' (6dabfd8e-fbee-49d2-99d9-d35bfec769f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c9430989-c765-49d8-8c41-5e8a79aa36c3 tempest-VolumesDeleteCascade-1308886050 None] Created volume successfully. Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Creating offline snapshot 811db553-49f8-4c73-b327-8e32d6e9702c of volume ebb50e16-1440-4b76-8838-7d65fc6d3654 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Flow 'volume_create_manager' (df67aac3-dc74-4f20-a248-95524035a387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccf0ab0-5fdd-44a8-89fc-de290d6c7a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e25cdb-93a2-4855-a326-5897b84ed2ef]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccf0ab0-5fdd-44a8-89fc-de290d6c7a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-740973117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00a2c195-bf09-4202-aa25-16d26c479904,host='devstack@QuobyteHD#QuobyteHD',id=acc973f5-4f67-4f9b-b518-c208f798a12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f5ecad09b84b22a4b30fb35c1185a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:17Z,use_quota=True,user_id='562059af28f54d68837405a940cb4d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8af3323f-06a3-4129-9035-d4341e4214e6),volume_type_id=8af3323f-06a3-4129-9035-d4341e4214e6)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eced4b73-726e-463a-bd8a-e1e4fd9476f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eced4b73-726e-463a-bd8a-e1e4fd9476f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece1cf73-61c9-4617-bd24-f2e4e8f992a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece1cf73-61c9-4617-bd24-f2e4e8f992a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acc973f5-4f67-4f9b-b518-c208f798a12a', 'volume_name': 'volume-acc973f5-4f67-4f9b-b518-c208f798a12a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f116d48-6a28-4994-8e1e-0b3dae75e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f116d48-6a28-4994-8e1e-0b3dae75e39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3724331-1ee1-4f14-b29e-c41712c65125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Volume acc973f5-4f67-4f9b-b518-c208f798a12a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acc973f5-4f67-4f9b-b518-c208f798a12a', 'volume_size': 1} Sep 09 16:49:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:16 devstack sudo[93141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 Sep 09 16:49:16 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:17 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654" returned: 0 in 0.504s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:17 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c 1G Sep 09 16:49:17 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:17 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c 1G" returned: 0 in 0.669s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:17 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c Sep 09 16:49:17 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:18 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c" returned: 0 in 0.415s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:18 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c is being set with open permissions: ugo+rw Sep 09 16:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:18 devstack sudo[93201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c Sep 09 16:49:18 devstack sudo[93201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:18 devstack sudo[93201]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:18 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.info Sep 09 16:49:18 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:19 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.info" returned: 0 in 0.381s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:19 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.info is being set with open permissions: ugo+rw Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:19 devstack sudo[93218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.info Sep 09 16:49:19 devstack sudo[93218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:19 devstack sudo[93218]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.info" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.735s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.586s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=00a2c195-bf09-4202-aa25-16d26c479904,created_at=2026-09-09T14:49:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-740973117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00a2c195-bf09-4202-aa25-16d26c479904,host='devstack@QuobyteHD#QuobyteHD',id=acc973f5-4f67-4f9b-b518-c208f798a12a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f5ecad09b84b22a4b30fb35c1185a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:17Z,use_quota=True,user_id='562059af28f54d68837405a940cb4d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8af3323f-06a3-4129-9035-d4341e4214e6),volume_type_id=8af3323f-06a3-4129-9035-d4341e4214e6)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Creating volume acc973f5-4f67-4f9b-b518-c208f798a12a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:49:19 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=112,cinder:UPDATE=120,cinder:INSERT=34,cinder:DELETE=10 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:49:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c943fe82-835c-4bf5-973f-5844a335f4d7 tempest-VolumesDeleteCascade-1308886050 None] Create snapshot completed successfully Sep 09 16:49:19 devstack sudo[93221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a 1073741824 Sep 09 16:49:19 devstack sudo[93221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=106,cinder:UPDATE=122,cinder:INSERT=23,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:49:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:20 devstack sudo[93221]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a 1073741824" returned: 0 in 0.629s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:20 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a Sep 09 16:49:20 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:20 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.621s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3724331-1ee1-4f14-b29e-c41712c65125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc973f5-4f67-4f9b-b518-c208f798a12a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eefdd0f-accf-4cc5-88e3-4c8199dbda42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] Creating offline snapshot 72065ac3-43fc-4417-8d23-b559bb9ebb4b of volume ebb50e16-1440-4b76-8838-7d65fc6d3654 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:49:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Volume volume-acc973f5-4f67-4f9b-b518-c208f798a12a (acc973f5-4f67-4f9b-b518-c208f798a12a): created successfully Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eefdd0f-accf-4cc5-88e3-4c8199dbda42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Flow 'volume_create_manager' (df67aac3-dc74-4f20-a248-95524035a387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[950de22d-173f-4424-88a2-f6d5bad7df93]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-89107a5b-c4f3-4e4f-832e-41b2e4c12373 tempest-GroupSnapshotsTest-53368159 None] Created volume successfully. Sep 09 16:49:20 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c Sep 09 16:49:20 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:21 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c" returned: 0 in 0.712s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb50e16-1440-4b76-8838-7d65fc6d3654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:49:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:21 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b 1G Sep 09 16:49:21 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:22 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b 1G" returned: 0 in 1.078s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:22 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b Sep 09 16:49:22 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Flow 'volume_create_manager' (a54a54bc-9ab5-4880-83b9-f575346f631e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d453c4-fc4d-48bc-bc4c-1f66be4a4854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d453c4-fc4d-48bc-bc4c-1f66be4a4854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-892363770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00a2c195-bf09-4202-aa25-16d26c479904,host='devstack@QuobyteHD#QuobyteHD',id=35ed8d12-da28-44f3-b5e5-8e3c353b9bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f5ecad09b84b22a4b30fb35c1185a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:23Z,use_quota=True,user_id='562059af28f54d68837405a940cb4d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8af3323f-06a3-4129-9035-d4341e4214e6),volume_type_id=8af3323f-06a3-4129-9035-d4341e4214e6)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8ec07f-037d-4a82-a350-eb95a5af2636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8ec07f-037d-4a82-a350-eb95a5af2636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0795d5-0309-4c5a-877d-cef542a2f095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c0795d5-0309-4c5a-877d-cef542a2f095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35ed8d12-da28-44f3-b5e5-8e3c353b9bb7', 'volume_name': 'volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02adee54-4259-4b52-94b9-27bce9f3be1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:22 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02adee54-4259-4b52-94b9-27bce9f3be1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecb994d-81b9-412e-b551-48243160926d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Volume 35ed8d12-da28-44f3-b5e5-8e3c353b9bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7', 'volume_size': 1} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b" returned: 0 in 0.698s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:23 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b is being set with open permissions: ugo+rw Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:23 devstack sudo[93294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b Sep 09 16:49:23 devstack sudo[93294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:23 devstack sudo[93294]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b" returned: 0 in 0.446s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.122s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.511s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=00a2c195-bf09-4202-aa25-16d26c479904,created_at=2026-09-09T14:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-892363770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00a2c195-bf09-4202-aa25-16d26c479904,host='devstack@QuobyteHD#QuobyteHD',id=35ed8d12-da28-44f3-b5e5-8e3c353b9bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f5ecad09b84b22a4b30fb35c1185a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:23Z,use_quota=True,user_id='562059af28f54d68837405a940cb4d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8af3323f-06a3-4129-9035-d4341e4214e6),volume_type_id=8af3323f-06a3-4129-9035-d4341e4214e6)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Creating volume 35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:49:23 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:49:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:23 devstack sudo[93297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 1073741824 Sep 09 16:49:23 devstack sudo[93297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-230c3a7b-74b3-4397-9bf0-6eada79b2421 tempest-VolumesDeleteCascade-1308886050 None] Create snapshot completed successfully Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-ebb50e16-1440-4b76-8838-7d65fc6d3654-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-ebb50e16-1440-4b76-8838-7d65fc6d3654-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:24 devstack sudo[93297]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 1073741824" returned: 0 in 0.711s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Performing cascade delete. {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-72065ac3-43fc-4417-8d23-b559bb9ebb4b-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-72065ac3-43fc-4417-8d23-b559bb9ebb4b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:24 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 Sep 09 16:49:24 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-ebb50e16-1440-4b76-8838-7d65fc6d3654" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-ebb50e16-1440-4b76-8838-7d65fc6d3654" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-72065ac3-43fc-4417-8d23-b559bb9ebb4b" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-72065ac3-43fc-4417-8d23-b559bb9ebb4b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Deleting offline snapshot 72065ac3-43fc-4417-8d23-b559bb9ebb4b of volume ebb50e16-1440-4b76-8838-7d65fc6d3654 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] snapshot_file for this snap is: volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[99827702-48cb-47cc-a29b-d45790cd03b6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:24 devstack sudo[93306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b Sep 09 16:49:24 devstack sudo[93306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:24 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" returned: 0 in 0.520s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecb994d-81b9-412e-b551-48243160926d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6f4180-20ec-4728-9102-9c1b9181a005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Volume volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 (35ed8d12-da28-44f3-b5e5-8e3c353b9bb7): created successfully Sep 09 16:49:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6f4180-20ec-4728-9102-9c1b9181a005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Flow 'volume_create_manager' (a54a54bc-9ab5-4880-83b9-f575346f631e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aeada85c-4060-4122-9c3f-bc946651ce00 tempest-GroupSnapshotsTest-53368159 None] Created volume successfully. Sep 09 16:49:25 devstack sudo[93306]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b" returned: 0 in 0.556s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb50e16-1440-4b76-8838-7d65fc6d3654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:49:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfa39ac-4b32-4ffe-a9e5-c5276cbe1f86]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:25 devstack sudo[93313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c Sep 09 16:49:25 devstack sudo[93313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:25 devstack sudo[93313]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c" returned: 0 in 0.669s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb50e16-1440-4b76-8838-7d65fc6d3654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:49:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fac12aa9-9dd7-4830-8379-79e797e487a0 tempest-GroupSnapshotsTest-53368159 None] Update group completed successfully. Sep 09 16:49:25 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b Sep 09 16:49:25 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:26 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b" returned: 0 in 0.496s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:26 devstack sudo[93325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b Sep 09 16:49:26 devstack sudo[93325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:26 devstack sudo[93325]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.72065ac3-43fc-4417-8d23-b559bb9ebb4b" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-72065ac3-43fc-4417-8d23-b559bb9ebb4b" released by "_delete_snapshot" :: held 2.276s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-ebb50e16-1440-4b76-8838-7d65fc6d3654" released by "delete_snapshot" :: held 2.321s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Created reservations ['e73eeafc-d55b-4039-81ff-e3ef2ca47764', 'd653bbb7-5d3b-4e59-98d7-2bb43687c7f0', '614e9aa1-4d66-4240-bec4-00a2af654481', '2ab5466c-6d8d-490f-8d9b-f517daf018af'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3c10f083-80c5-4cd6-a117-162ee0b64f50 tempest-GroupSnapshotsTest-53368159 None] Update group completed successfully. Sep 09 16:49:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Delete snapshot completed successfully. Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-72065ac3-43fc-4417-8d23-b559bb9ebb4b-delete_snapshot" released by "delete_snapshot" :: held 2.754s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-811db553-49f8-4c73-b327-8e32d6e9702c-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-811db553-49f8-4c73-b327-8e32d6e9702c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-ebb50e16-1440-4b76-8838-7d65fc6d3654" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-ebb50e16-1440-4b76-8838-7d65fc6d3654" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-811db553-49f8-4c73-b327-8e32d6e9702c" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-811db553-49f8-4c73-b327-8e32d6e9702c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Deleting offline snapshot 811db553-49f8-4c73-b327-8e32d6e9702c of volume ebb50e16-1440-4b76-8838-7d65fc6d3654 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] snapshot_file for this snap is: volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b3196-311f-43cb-9871-96f0382ca7b9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:27 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c Sep 09 16:49:27 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:27 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c" returned: 0 in 0.597s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb50e16-1440-4b76-8838-7d65fc6d3654(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ed286f-9b91-4d59-9b8b-be155ad2ec47]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:28 devstack sudo[93340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 Sep 09 16:49:28 devstack sudo[93340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7b612e1c-4fb9-4b61-9767-95d7260107e0 tempest-GroupSnapshotsTest-53368159 None] Update group completed successfully. Sep 09 16:49:28 devstack sudo[93340]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654" returned: 0 in 0.582s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:28 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c Sep 09 16:49:28 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:29 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c" returned: 0 in 0.459s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:29 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c Sep 09 16:49:29 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:29 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654.811db553-49f8-4c73-b327-8e32d6e9702c" returned: 0 in 0.355s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-811db553-49f8-4c73-b327-8e32d6e9702c" released by "_delete_snapshot" :: held 2.159s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-ebb50e16-1440-4b76-8838-7d65fc6d3654" released by "delete_snapshot" :: held 2.199s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Created reservations ['313e6a43-6d0c-46cd-93ef-bc98265329c6', 'c9110bec-cb65-4f52-9d13-4b49f4524e0d', 'b4dec0e1-c967-4e44-a63a-f60b2626a017', 'c13d3d88-54b3-47fe-821c-f1fa7af5de84'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-09f2dc4e-90a4-43b6-9376-a433de376795 tempest-GroupSnapshotsTest-53368159 None] Update group completed successfully. Sep 09 16:49:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Delete snapshot completed successfully. Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-811db553-49f8-4c73-b327-8e32d6e9702c-delete_snapshot" released by "delete_snapshot" :: held 2.675s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Snapshots deleted, issuing volume delete {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-ebb50e16-1440-4b76-8838-7d65fc6d3654" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-ebb50e16-1440-4b76-8838-7d65fc6d3654" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a594a7-7c0e-4ec8-951f-c3d4c0ff9312]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:30 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 Sep 09 16:49:30 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:30 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654" returned: 0 in 0.584s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:30 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654 Sep 09 16:49:30 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:30 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ebb50e16-1440-4b76-8838-7d65fc6d3654" returned: 0 in 0.407s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-ebb50e16-1440-4b76-8838-7d65fc6d3654" released by "delete_volume" :: held 1.118s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Created reservations ['0cbe87f5-4b3c-4890-9767-9877b17556e3', 'a7ac518e-81be-45ce-95fb-41ee2ec9957f', '10c18f37-b2dd-450d-a4ae-8da8cffa83b2', '63656ad2-8311-4636-813e-c62e665eaf9d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:31 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:49:31 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] GroupSnapshot 20899e90-3d69-4487-a616-13321c67beda: creating. Sep 09 16:49:31 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:49:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Deleted volume successfully. Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Group snapshot 20899e90-3d69-4487-a616-13321c67beda: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8860b9cc-7c40-4914-99e6-9c266732029c tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-ebb50e16-1440-4b76-8838-7d65fc6d3654-delete_volume" released by "delete_volume" :: held 7.359s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Creating offline snapshot 9e3459f6-41b0-4ac0-a203-660d7abaac0e of volume 35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[07791d0f-d019-4c3d-a5a0-528167c44a79]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:31 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 Sep 09 16:49:31 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:32 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:32 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e 1G Sep 09 16:49:32 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:32 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e 1G" returned: 0 in 0.771s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:32 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e Sep 09 16:49:32 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:33 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e" returned: 0 in 1.019s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:33 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:49:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:33 devstack sudo[93452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e Sep 09 16:49:33 devstack sudo[93452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:33 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Flow 'volume_create_manager' (621a414f-a5f6-4695-9266-3b19d951fca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c0457e-3881-486e-8f1d-41ba3a015487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28c0457e-3881-486e-8f1d-41ba3a015487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-411149435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a8924f-27db-4332-8177-033a208b5af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d596e3cca7e48c8a2283390f228223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:34Z,use_quota=True,user_id='fb2ae948cd3647d9b34702529c7ae3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59253d98-d2d7-4269-9c3d-1166e980635a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59253d98-d2d7-4269-9c3d-1166e980635a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0fad0c-8226-47b6-a9e1-2c05f6b2c40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac0fad0c-8226-47b6-a9e1-2c05f6b2c40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8a8924f-27db-4332-8177-033a208b5af4', 'volume_name': 'volume-a8a8924f-27db-4332-8177-033a208b5af4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b710268-4f99-490d-a94d-8cf5c1faa988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b710268-4f99-490d-a94d-8cf5c1faa988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b47418a-7b87-4e04-9dda-0aeff228c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Volume a8a8924f-27db-4332-8177-033a208b5af4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8a8924f-27db-4332-8177-033a208b5af4', 'volume_size': 1} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:34 devstack sudo[93452]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e" returned: 0 in 0.652s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:34 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.info Sep 09 16:49:34 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:34 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.info" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:34 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:49:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:35 devstack sudo[93473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.info Sep 09 16:49:35 devstack sudo[93473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:35 devstack sudo[93473]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.info" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.782s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Creating offline snapshot afce406b-7331-4340-885e-b7b1f35ab5d4 of volume acc973f5-4f67-4f9b-b518-c208f798a12a {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:49:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3879ec-ba47-4d45-80d8-aba1ce7380e1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:35 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a Sep 09 16:49:35 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:36 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a" returned: 0 in 0.575s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:36 devstack sudo[93505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 1G Sep 09 16:49:36 devstack sudo[93505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:36 devstack sudo[93505]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 1G" returned: 0 in 0.463s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acc973f5-4f67-4f9b-b518-c208f798a12a -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:36 devstack sudo[93511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acc973f5-4f67-4f9b-b518-c208f798a12a -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 Sep 09 16:49:36 devstack sudo[93511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:36 devstack sudo[93511]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-acc973f5-4f67-4f9b-b518-c208f798a12a -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:36 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:49:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:36 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 Sep 09 16:49:36 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:37 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:37 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.info Sep 09 16:49:37 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:37 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.info" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:37 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:37 devstack sudo[93522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.info Sep 09 16:49:37 devstack sudo[93522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:37 devstack sudo[93522]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.info" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.449s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.724s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-411149435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8a8924f-27db-4332-8177-033a208b5af4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d596e3cca7e48c8a2283390f228223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:34Z,use_quota=True,user_id='fb2ae948cd3647d9b34702529c7ae3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Creating volume a8a8924f-27db-4332-8177-033a208b5af4 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:49:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:49:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:37 devstack sudo[93525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 1073741824 Sep 09 16:49:37 devstack sudo[93525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7233cbb6-b373-4d84-ac04-d668e45b8a18 tempest-GroupSnapshotsTest-53368159 None] group_snapshot 20899e90-3d69-4487-a616-13321c67beda: created successfully Sep 09 16:49:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] group_snapshot 20899e90-3d69-4487-a616-13321c67beda: deleting Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] group_snapshot 20899e90-3d69-4487-a616-13321c67beda: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-9e3459f6-41b0-4ac0-a203-660d7abaac0e" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-9e3459f6-41b0-4ac0-a203-660d7abaac0e" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Deleting offline snapshot 9e3459f6-41b0-4ac0-a203-660d7abaac0e of volume 35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] snapshot_file for this snap is: volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dca535-87fc-44d4-96b1-f95e46d2a192]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:38 devstack sudo[93525]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 1073741824" returned: 0 in 0.801s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:38 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 Sep 09 16:49:38 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:38 devstack sudo[93531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e Sep 09 16:49:38 devstack sudo[93531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:39 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4" returned: 0 in 0.425s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] <== create_volume: return (1303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b47418a-7b87-4e04-9dda-0aeff228c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8a8924f-27db-4332-8177-033a208b5af4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:39 devstack sudo[93531]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91c3c9f-2d0c-4505-96ef-15673247ba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e" returned: 0 in 0.567s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:49:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Volume volume-a8a8924f-27db-4332-8177-033a208b5af4 (a8a8924f-27db-4332-8177-033a208b5af4): created successfully Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a91c3c9f-2d0c-4505-96ef-15673247ba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Flow 'volume_create_manager' (621a414f-a5f6-4695-9266-3b19d951fca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[123a0519-5f96-4402-91ae-62e8bbe3daa7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fff3c578-8565-4eb2-b271-6e1f1a6ceb6e tempest-VolumesDeleteCascade-1308886050 None] Created volume successfully. Sep 09 16:49:39 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 Sep 09 16:49:39 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:39 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:39 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e Sep 09 16:49:39 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:40 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e" returned: 0 in 0.388s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:40 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e Sep 09 16:49:40 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:40 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7.9e3459f6-41b0-4ac0-a203-660d7abaac0e" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-9e3459f6-41b0-4ac0-a203-660d7abaac0e" released by "_delete_snapshot" :: held 1.827s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" released by "delete_snapshot" :: held 1.879s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-acc973f5-4f67-4f9b-b518-c208f798a12a" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-acc973f5-4f67-4f9b-b518-c208f798a12a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-afce406b-7331-4340-885e-b7b1f35ab5d4" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-afce406b-7331-4340-885e-b7b1f35ab5d4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Deleting offline snapshot afce406b-7331-4340-885e-b7b1f35ab5d4 of volume acc973f5-4f67-4f9b-b518-c208f798a12a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] snapshot_file for this snap is: volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7659e77d-2fd8-4366-9531-79d3c2045c5c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Creating offline snapshot a9e40320-939f-4957-9225-40990d7000e5 of volume a8a8924f-27db-4332-8177-033a208b5af4 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbaf3a7-e608-477f-8255-42735b357994]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:40 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 Sep 09 16:49:40 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:40 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 Sep 09 16:49:40 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:40 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-acc973f5-4f67-4f9b-b518-c208f798a12a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce55aa41-fcda-4240-bbc0-3c318f21cc54]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:41 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4" returned: 0 in 0.383s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:41 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 1G Sep 09 16:49:41 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:41 devstack sudo[93572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a Sep 09 16:49:41 devstack sudo[93572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:41 devstack sudo[93572]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:41 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 Sep 09 16:49:41 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:41 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 1G" returned: 0 in 0.496s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a8924f-27db-4332-8177-033a208b5af4 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:41 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a8924f-27db-4332-8177-033a208b5af4 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 Sep 09 16:49:41 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:41 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:41 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4 Sep 09 16:49:41 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:41 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8a8924f-27db-4332-8177-033a208b5af4 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 is being set with open permissions: ugo+rw Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:41 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 Sep 09 16:49:41 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:41 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a.afce406b-7331-4340-885e-b7b1f35ab5d4" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-afce406b-7331-4340-885e-b7b1f35ab5d4" released by "_delete_snapshot" :: held 1.545s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-acc973f5-4f67-4f9b-b518-c208f798a12a" released by "delete_snapshot" :: held 1.573s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:42 devstack cinder-volume[87498]: WARNING cinder.quota [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1560507178 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1560507178, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:49:42 devstack cinder-volume[87498]: WARNING cinder.quota [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1560507178 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1560507178, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:49:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Created reservations ['57d0c107-c0d4-4ebc-8cd4-7dc98738a24c', 'f09437f7-b417-4075-971a-4e43a93c5dd1', '4f332bd4-086c-4f68-84fd-c97cfbc02f7f', '0ddcf9ca-6cc6-4646-8031-24903681f019'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:42 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:42 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.info Sep 09 16:49:42 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] Created reservations ['622e4a02-0b24-48cc-b56c-0ed5779248d5', '1442ac09-4f26-48be-92b1-a771deb5aaac', 'ccfc3604-e23c-48e7-86fa-940b36307d92', 'e5fe7b75-e5d3-4b4c-b384-51f8cb680bc2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1eb1b5ea-f876-4585-9a6a-5d5b92948279 tempest-GroupSnapshotsTest-53368159 None] group_snapshot 20899e90-3d69-4487-a616-13321c67beda: deleted successfully Sep 09 16:49:42 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.info" returned: 0 in 0.284s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:42 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.info is being set with open permissions: ugo+rw Sep 09 16:49:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:42 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.info Sep 09 16:49:42 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:42 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.info" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.142s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1430cf43-a389-4843-a597-0afb88feb2a5 tempest-VolumesDeleteCascade-1308886050 None] Create snapshot completed successfully Sep 09 16:49:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" acquired by "delete_volume" :: waited 0.049s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8045b2-878c-4f6a-9ea4-4d8ece28de3a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:44 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 Sep 09 16:49:44 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:44 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" returned: 0 in 0.481s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:44 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7 Sep 09 16:49:44 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Flow 'volume_create_manager' (4b04b140-5118-46b9-9505-afe3b19cc820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc4304e-e339-4f8e-a1cd-48f92f6d5d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc4304e-e339-4f8e-a1cd-48f92f6d5d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-20816364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f45ab4b8-7011-4ceb-8999-dd3ef2f511ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d596e3cca7e48c8a2283390f228223e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a9e40320-939f-4957-9225-40990d7000e5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:45Z,use_quota=True,user_id='fb2ae948cd3647d9b34702529c7ae3fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c13c98-5d83-4777-b250-17f852e7a308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c13c98-5d83-4777-b250-17f852e7a308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a887f5-a03f-47e7-ad74-d917f83ee755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54a887f5-a03f-47e7-ad74-d917f83ee755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f45ab4b8-7011-4ceb-8999-dd3ef2f511ed', 'volume_name': 'volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed', 'volume_size': 1, 'snapshot_id': 'a9e40320-939f-4957-9225-40990d7000e5'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba93647-067e-461a-86f4-22a47af9fb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ba93647-067e-461a-86f4-22a47af9fb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20a6886-c789-498e-ba12-1a0d309b0466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Volume f45ab4b8-7011-4ceb-8999-dd3ef2f511ed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed', 'volume_size': 1, 'snapshot_id': 'a9e40320-939f-4957-9225-40990d7000e5'} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-a9e40320-939f-4957-9225-40990d7000e5-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-a9e40320-939f-4957-9225-40990d7000e5-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Creating volume f45ab4b8-7011-4ceb-8999-dd3ef2f511ed from snapshot a9e40320-939f-4957-9225-40990d7000e5 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] snapshot: a9e40320-939f-4957-9225-40990d7000e5, volume: f45ab4b8-7011-4ceb-8999-dd3ef2f511ed, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 16:49:44 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-35ed8d12-da28-44f3-b5e5-8e3c353b9bb7" released by "delete_volume" :: held 0.921s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-acc973f5-4f67-4f9b-b518-c208f798a12a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f666ec1c-6a61-4330-9393-536081b7255d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-acc973f5-4f67-4f9b-b518-c208f798a12a" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7748dd-b46a-4c76-8edc-1b56a7eec704]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:45 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 Sep 09 16:49:45 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:45 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a Sep 09 16:49:45 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:45 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:49:45 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:45 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5" returned: 0 in 0.636s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8a8924f-27db-4332-8177-033a208b5af4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:49:45 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.481s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dde2253-6ecf-494d-bc83-88569cdf8c95]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 8 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:49:45 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a" returned: 0 in 0.681s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:45 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a Sep 09 16:49:45 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:45 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 Sep 09 16:49:45 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:45 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-acc973f5-4f67-4f9b-b518-c208f798a12a" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-acc973f5-4f67-4f9b-b518-c208f798a12a" released by "delete_volume" :: held 1.010s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Created reservations ['f043e840-59c4-487f-8eb0-2728be943735'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:45 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4" returned: 0 in 0.472s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 16:49:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:46 devstack cinder-volume[87498]: WARNING cinder.quota [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1560507178 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1560507178, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:49:46 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed Sep 09 16:49:46 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:46 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Created reservations ['567a1d2d-6a4f-4660-a391-c3042de026e4', 'ad720af8-7853-4684-be85-5c5979c1b69d', '54c2847e-63ed-43fd-8db0-c697fb726d83', '4f82ace1-a537-49df-919f-494728de5cee'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:46 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Created reservations ['f0692c95-5be5-4003-a0df-85965c466f1d', '93749253-019d-4a2f-a290-10cc378c7209', '432f0c1a-dc03-4b02-ab0e-72f680a85b42', '07a89852-9e8b-4072-ab6f-c2e294c44e21'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:46 devstack sudo[93640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:49:46 devstack sudo[93640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:46 devstack sudo[93640]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:46 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:49:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c5d46eb8-376a-4838-988c-d87111454f4c tempest-GroupSnapshotsTest-53368159 None] Delete group completed successfully. Sep 09 16:49:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4a54264b-8e8a-4b5e-a477-41f8e6f95e72 tempest-GroupSnapshotsTest-53368159 None] Group tempest-GroupSnapshotsTest-Group-312555617: creating Sep 09 16:49:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4a54264b-8e8a-4b5e-a477-41f8e6f95e72 tempest-GroupSnapshotsTest-53368159 None] Group tempest-GroupSnapshotsTest-Group-312555617: created successfully Sep 09 16:49:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4a54264b-8e8a-4b5e-a477-41f8e6f95e72 tempest-GroupSnapshotsTest-53368159 None] Create group completed successfully. Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Flow 'volume_create_manager' (7c758115-7722-4f4f-b123-1e8d1ea725cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcae64e6-e31c-457a-838c-34aaf722bd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcae64e6-e31c-457a-838c-34aaf722bd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1117930851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d878294-9a53-41a2-ae73-ea9354ced4e7,host='devstack@QuobyteHD#QuobyteHD',id=8ca85044-8faf-4d3e-a942-5503e299ea4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f5ecad09b84b22a4b30fb35c1185a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:50Z,use_quota=True,user_id='562059af28f54d68837405a940cb4d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad3e66a-76ca-4cd7-a635-68665087aa8d),volume_type_id=8ad3e66a-76ca-4cd7-a635-68665087aa8d)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a209ef8c-b371-407e-adc8-03373941fe45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a209ef8c-b371-407e-adc8-03373941fe45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600d96b7-f2fb-496c-8bf4-ea8a2b2da80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (600d96b7-f2fb-496c-8bf4-ea8a2b2da80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca85044-8faf-4d3e-a942-5503e299ea4d', 'volume_name': 'volume-8ca85044-8faf-4d3e-a942-5503e299ea4d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7985430a-0e41-4f3f-a070-d5c9e02bbfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7985430a-0e41-4f3f-a070-d5c9e02bbfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071c43c1-26a3-4933-b237-7be02717c528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Volume 8ca85044-8faf-4d3e-a942-5503e299ea4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca85044-8faf-4d3e-a942-5503e299ea4d', 'volume_size': 1} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-23e09ea2-6362-40f1-ac45-b1a8d67c6e94 req-2dd592fe-f462-4ede-a37a-b126db241dcc tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:51 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" returned: 0 in 5.802s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:51 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:49:51 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Converted 1024.00 MB image at 176.45 MB/s Sep 09 16:49:51 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed is being set with open permissions: ugo+rw Sep 09 16:49:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:51 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed Sep 09 16:49:51 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:52 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" released by "_copy_volume_from_snapshot" :: held 7.303s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-a9e40320-939f-4957-9225-40990d7000e5-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" released by "_create_volume_from_snapshot" :: held 7.379s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.403s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.436s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d878294-9a53-41a2-ae73-ea9354ced4e7,created_at=2026-09-09T14:49:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1117930851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d878294-9a53-41a2-ae73-ea9354ced4e7,host='devstack@QuobyteHD#QuobyteHD',id=8ca85044-8faf-4d3e-a942-5503e299ea4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18f5ecad09b84b22a4b30fb35c1185a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:50Z,use_quota=True,user_id='562059af28f54d68837405a940cb4d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ad3e66a-76ca-4cd7-a635-68665087aa8d),volume_type_id=8ad3e66a-76ca-4cd7-a635-68665087aa8d)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Creating volume 8ca85044-8faf-4d3e-a942-5503e299ea4d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:49:52 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:52 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d 1073741824 Sep 09 16:49:52 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20a6886-c789-498e-ba12-1a0d309b0466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed', 'volume_size': 1, 'snapshot_id': 'a9e40320-939f-4957-9225-40990d7000e5'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017edcb1-a967-41ee-93de-707da97b803d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Volume volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed (f45ab4b8-7011-4ceb-8999-dd3ef2f511ed): created successfully Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (017edcb1-a967-41ee-93de-707da97b803d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Flow 'volume_create_manager' (4b04b140-5118-46b9-9505-afe3b19cc820) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0d2443a4-89a9-4a92-999a-9afdcee54a9f tempest-VolumesDeleteCascade-1308886050 None] Created volume successfully. Sep 09 16:49:52 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d 1073741824" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:52 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d Sep 09 16:49:52 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:52 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-23e09ea2-6362-40f1-ac45-b1a8d67c6e94 req-2dd592fe-f462-4ede-a37a-b126db241dcc tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.929s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (071c43c1-26a3-4933-b237-7be02717c528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca85044-8faf-4d3e-a942-5503e299ea4d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebe4ef0-e61f-4fae-b5e3-b1aff2ec03e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-a8a8924f-27db-4332-8177-033a208b5af4-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-23e09ea2-6362-40f1-ac45-b1a8d67c6e94 req-2dd592fe-f462-4ede-a37a-b126db241dcc tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Volume volume-8ca85044-8faf-4d3e-a942-5503e299ea4d (8ca85044-8faf-4d3e-a942-5503e299ea4d): created successfully Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebe4ef0-e61f-4fae-b5e3-b1aff2ec03e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Flow 'volume_create_manager' (7c758115-7722-4f4f-b123-1e8d1ea725cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-a8a8924f-27db-4332-8177-033a208b5af4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0afe76d3-ad76-4125-ac63-b2fff5ee4b1b tempest-GroupSnapshotsTest-53368159 None] Created volume successfully. Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-23e09ea2-6362-40f1-ac45-b1a8d67c6e94 req-2dd592fe-f462-4ede-a37a-b126db241dcc tempest-ServerActionsTestOtherA-40635085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-2e12b49d-f852-4874-8dc0-4601add3c653', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cb4a698-2b1e-4bd6-8f17-90d3675917d2', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:49:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Performing cascade delete. {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-a9e40320-939f-4957-9225-40990d7000e5-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-a9e40320-939f-4957-9225-40990d7000e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-23e09ea2-6362-40f1-ac45-b1a8d67c6e94 req-2dd592fe-f462-4ede-a37a-b126db241dcc tempest-ServerActionsTestOtherA-40635085 None] attachment_update completed successfully. Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-a8a8924f-27db-4332-8177-033a208b5af4" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-a8a8924f-27db-4332-8177-033a208b5af4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-a9e40320-939f-4957-9225-40990d7000e5" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-a9e40320-939f-4957-9225-40990d7000e5" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Deleting offline snapshot a9e40320-939f-4957-9225-40990d7000e5 of volume a8a8924f-27db-4332-8177-033a208b5af4 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] snapshot_file for this snap is: volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[803f1ead-f49f-4e1c-abe6-6b5ac96f2337]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] GroupSnapshot d4f9c4f6-26a7-47a1-a271-23389da17e10: creating. Sep 09 16:49:53 devstack sudo[93735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 Sep 09 16:49:53 devstack sudo[93735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Group snapshot d4f9c4f6-26a7-47a1-a271-23389da17e10: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Creating offline snapshot d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 of volume 8ca85044-8faf-4d3e-a942-5503e299ea4d {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[205c23e6-f290-4f27-8eaa-5191a4e54e3e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:53 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d Sep 09 16:49:53 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:53 devstack sudo[93735]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8a8924f-27db-4332-8177-033a208b5af4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff6a636-c125-4eea-b51e-1340cb75697d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:53 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:53 devstack sudo[94128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 1G Sep 09 16:49:53 devstack sudo[94128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:53 devstack sudo[94125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 Sep 09 16:49:53 devstack sudo[94125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:54 devstack sudo[94128]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 1G" returned: 0 in 0.383s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca85044-8faf-4d3e-a942-5503e299ea4d -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:54 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca85044-8faf-4d3e-a942-5503e299ea4d -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 Sep 09 16:49:54 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:54 devstack sudo[94125]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4" returned: 0 in 0.573s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:54 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 Sep 09 16:49:54 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:54 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ca85044-8faf-4d3e-a942-5503e299ea4d -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:54 devstack sudo[94145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 Sep 09 16:49:54 devstack sudo[94145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:54 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:54 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5 Sep 09 16:49:54 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:54 devstack sudo[94145]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:54 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.info Sep 09 16:49:54 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:54 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4.a9e40320-939f-4957-9225-40990d7000e5" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-a9e40320-939f-4957-9225-40990d7000e5" released by "_delete_snapshot" :: held 1.814s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-a8a8924f-27db-4332-8177-033a208b5af4" released by "delete_snapshot" :: held 1.838s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:54 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.info" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Created reservations ['be7e3b01-4123-480e-a30c-eb743adf5fcb', 'f4dbda9e-6ce3-4a6c-ad35-418974579951', 'f36d015f-b880-4c9c-94cd-07f39a0c3943', 'da9a51cf-8f92-46b7-8911-09181c0e3d88'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:55 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.info Sep 09 16:49:55 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Delete snapshot completed successfully. Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-a9e40320-939f-4957-9225-40990d7000e5-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Snapshots deleted, issuing volume delete {{(pid=87498) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-a8a8924f-27db-4332-8177-033a208b5af4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-a8a8924f-27db-4332-8177-033a208b5af4" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[82239526-ba93-490f-9b4f-5071022870a9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:55 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.info" returned: 0 in 0.266s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:55 devstack sudo[94160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 Sep 09 16:49:55 devstack sudo[94160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-523c4949-530c-4a94-a88e-ef9ca8debaa8 tempest-GroupSnapshotsTest-53368159 None] group_snapshot d4f9c4f6-26a7-47a1-a271-23389da17e10: created successfully Sep 09 16:49:55 devstack sudo[94160]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4" returned: 0 in 0.494s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] group_snapshot d4f9c4f6-26a7-47a1-a271-23389da17e10: deleting Sep 09 16:49:55 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4 Sep 09 16:49:55 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] group_snapshot d4f9c4f6-26a7-47a1-a271-23389da17e10: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-8ca85044-8faf-4d3e-a942-5503e299ea4d" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-8ca85044-8faf-4d3e-a942-5503e299ea4d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-d8cd64b8-b7a7-4e6d-b639-79111ad6ac21" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-d8cd64b8-b7a7-4e6d-b639-79111ad6ac21" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Deleting offline snapshot d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 of volume 8ca85044-8faf-4d3e-a942-5503e299ea4d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] snapshot_file for this snap is: volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[766809a5-fb6b-451c-a68f-f9faaf74c50d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:55 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 Sep 09 16:49:55 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:56 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a8a8924f-27db-4332-8177-033a208b5af4" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-a8a8924f-27db-4332-8177-033a208b5af4" released by "delete_volume" :: held 0.942s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Created reservations ['40b6a71b-8834-476d-941d-79446ea8996f', 'c4dfdd9c-0739-4bf6-b704-a0fee441dbca', '3a0d1d93-e480-4aec-8e3d-e0135988556e', 'fac64265-46bb-4356-a361-dc7e739cfd28'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:56 devstack sudo[94176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:49:56 devstack sudo[94176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:56 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ca85044-8faf-4d3e-a942-5503e299ea4d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a4c7ba-9733-4d00-9238-540dc54b3ab7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:56 devstack sudo[94182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d Sep 09 16:49:56 devstack sudo[94182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:56 devstack sudo[94176]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:49:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Deleted volume successfully. Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7776fd0e-9045-4209-8da0-a59b78304f27 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-a8a8924f-27db-4332-8177-033a208b5af4-delete_volume" released by "delete_volume" :: held 3.636s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-2ec26316-6e04-405a-bae8-ad6d5a4b4cb5 req-cf59ca3b-46dd-4961-b604-146cafa2f5ac tempest-ServerActionsTestOtherA-40635085 None] Terminate volume connection completed successfully. Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-2ec26316-6e04-405a-bae8-ad6d5a4b4cb5 req-cf59ca3b-46dd-4961-b604-146cafa2f5ac tempest-ServerActionsTestOtherA-40635085 None] Deleting attachment 8cb4a698-2b1e-4bd6-8f17-90d3675917d2. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:49:56 devstack sudo[94182]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:56 devstack sudo[94218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 Sep 09 16:49:56 devstack sudo[94218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:57 devstack sudo[94218]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21" returned: 0 in 0.660s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:57 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21 Sep 09 16:49:57 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "cinder-quobyte-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:57 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4236eb6e-92bf-4e5a-9dd9-a1600de2b58e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d.d8cd64b8-b7a7-4e6d-b639-79111ad6ac21" returned: 0 in 0.400s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-d8cd64b8-b7a7-4e6d-b639-79111ad6ac21" released by "_delete_snapshot" :: held 2.075s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-8ca85044-8faf-4d3e-a942-5503e299ea4d" released by "delete_snapshot" :: held 2.108s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-2ec26316-6e04-405a-bae8-ad6d5a4b4cb5 req-dd3f2243-5c23-46c2-90a7-a5c008296309 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-2ec26316-6e04-405a-bae8-ad6d5a4b4cb5 req-dd3f2243-5c23-46c2-90a7-a5c008296309 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:58 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed Sep 09 16:49:58 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-2ec26316-6e04-405a-bae8-ad6d5a4b4cb5 req-dd3f2243-5c23-46c2-90a7-a5c008296309 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:58 devstack cinder-volume[87498]: WARNING cinder.quota [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1194346979 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1194346979, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:49:58 devstack cinder-volume[87498]: WARNING cinder.quota [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1194346979 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1194346979, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-2ec26316-6e04-405a-bae8-ad6d5a4b4cb5 req-dd3f2243-5c23-46c2-90a7-a5c008296309 tempest-ServerActionsTestOtherA-40635085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-2e12b49d-f852-4874-8dc0-4601add3c653', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e96876ef-8496-4573-bd1b-a05a106a0e97', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] Created reservations ['1f5e258b-cf15-43dd-b916-d3e06e6b4653', '95b6d2db-3041-4d58-9beb-6f19ce0877dd', '3fb1c7ff-b8c9-4650-8486-8e03885f3cae', '4ec5de5a-d320-4919-8388-af9b13568eac'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-2ec26316-6e04-405a-bae8-ad6d5a4b4cb5 req-dd3f2243-5c23-46c2-90a7-a5c008296309 tempest-ServerActionsTestOtherA-40635085 None] attachment_update completed successfully. Sep 09 16:49:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-27e2fc3a-4649-4c16-bdd3-4a2cf5d07637 tempest-GroupSnapshotsTest-53368159 None] group_snapshot d4f9c4f6-26a7-47a1-a271-23389da17e10: deleted successfully Sep 09 16:49:58 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:58 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed Sep 09 16:49:58 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:58 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-quobyte-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed" released by "delete_volume" :: held 0.883s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Created reservations ['1c919680-4a41-4af3-af89-123661ebe2c7', '1288ba14-a124-48b8-8069-58fe717a9145', 'd443d452-43f0-4f8c-b871-359abfe537b8', 'e2d4b395-0029-479a-b479-74a7b5cbdd44'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:58 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:49:58 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:59 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:49:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Deleted volume successfully. Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-963b55da-c912-4144-8330-ae44245009d7 tempest-VolumesDeleteCascade-1308886050 None] Lock "cinder-f45ab4b8-7011-4ceb-8999-dd3ef2f511ed-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Flow 'volume_create_manager' (60749137-ec9c-458e-a521-96b8d429648e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed3d435-37c7-4e38-84b4-4accc59b6fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ed3d435-37c7-4e38-84b4-4accc59b6fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1449458545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03ab59a-40d4-419c-9a80-b14d28579824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc48979dfa747098df5d387cd8bf336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:59Z,use_quota=True,user_id='0d3a301f2b2345e5af689aa76bb10838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746d6079-f593-4c20-8e92-989c5932cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (746d6079-f593-4c20-8e92-989c5932cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d825fff-fa5b-4130-acfe-f69ad83fc249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d825fff-fa5b-4130-acfe-f69ad83fc249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03ab59a-40d4-419c-9a80-b14d28579824', 'volume_name': 'volume-a03ab59a-40d4-419c-9a80-b14d28579824', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931ab2c7-6df4-4341-9b18-34017a9987d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931ab2c7-6df4-4341-9b18-34017a9987d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00de925f-a595-4dd8-8ae4-8b8265cc01cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:49:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Volume a03ab59a-40d4-419c-9a80-b14d28579824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03ab59a-40d4-419c-9a80-b14d28579824', 'volume_size': 1} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:49:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1449458545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03ab59a-40d4-419c-9a80-b14d28579824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc48979dfa747098df5d387cd8bf336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:49:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:49:59Z,use_quota=True,user_id='0d3a301f2b2345e5af689aa76bb10838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Creating volume a03ab59a-40d4-419c-9a80-b14d28579824 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:49:59 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:59 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824 1073741824 Sep 09 16:49:59 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "cinder-quobyte-8ca85044-8faf-4d3e-a942-5503e299ea4d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-8ca85044-8faf-4d3e-a942-5503e299ea4d" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b22e11-bc65-46c0-b1e6-aecfb7e30911]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:49:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:49:59 devstack sudo[94352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d Sep 09 16:49:59 devstack sudo[94352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:00 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824 1073741824" returned: 0 in 0.753s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:00 devstack sudo[94352]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d" returned: 0 in 0.727s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:00 devstack sudo[94707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d Sep 09 16:50:00 devstack sudo[94707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:00 devstack sudo[94709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824 Sep 09 16:50:00 devstack sudo[94709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:00 devstack sudo[94707]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8ca85044-8faf-4d3e-a942-5503e299ea4d" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:00 devstack sudo[94709]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Lock "cinder-quobyte-8ca85044-8faf-4d3e-a942-5503e299ea4d" released by "delete_volume" :: held 1.234s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00de925f-a595-4dd8-8ae4-8b8265cc01cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03ab59a-40d4-419c-9a80-b14d28579824', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4701b43b-fe39-4038-bfe5-bf6ba7468102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Volume volume-a03ab59a-40d4-419c-9a80-b14d28579824 (a03ab59a-40d4-419c-9a80-b14d28579824): created successfully Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4701b43b-fe39-4038-bfe5-bf6ba7468102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Flow 'volume_create_manager' (60749137-ec9c-458e-a521-96b8d429648e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:01 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Created reservations ['085ada75-733b-4eb2-a1df-8f45b93fa4bf'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:50:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5a65beae-b9f0-4d77-b859-bddb07c8983f tempest-AttachVolumeNegativeTest-1647988275 None] Created volume successfully. Sep 09 16:50:01 devstack cinder-volume[87498]: WARNING cinder.quota [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1194346979 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1194346979, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:50:01 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Created reservations ['29b817e8-ad26-4291-9873-2cbff855a0c8', '044abfeb-3fc5-4e29-ac27-41e96a266bca', '6d9b5c03-ddcb-4d51-9bd7-33b7f6783239', '81252746-b493-4bcd-b6e9-21e2c0e3b8ed'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:01 devstack sudo[94724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:50:01 devstack sudo[94724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:01 devstack sudo[94724]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:01 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:50:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ee21a03b-ecea-4517-a2e1-8d3659c39664 tempest-GroupSnapshotsTest-53368159 None] Delete group completed successfully. Sep 09 16:50:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-086aa385-3461-4e1b-9bb9-c063b8ef9d1a req-ad339d82-2095-450d-bfaa-f3dfbb4d7106 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-086aa385-3461-4e1b-9bb9-c063b8ef9d1a req-ad339d82-2095-450d-bfaa-f3dfbb4d7106 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-086aa385-3461-4e1b-9bb9-c063b8ef9d1a req-ad339d82-2095-450d-bfaa-f3dfbb4d7106 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-086aa385-3461-4e1b-9bb9-c063b8ef9d1a req-ad339d82-2095-450d-bfaa-f3dfbb4d7106 tempest-AttachVolumeNegativeTest-1647988275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-a03ab59a-40d4-419c-9a80-b14d28579824', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b986433-8b04-460c-a1bb-9d2646261a9e', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:50:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-086aa385-3461-4e1b-9bb9-c063b8ef9d1a req-ad339d82-2095-450d-bfaa-f3dfbb4d7106 tempest-AttachVolumeNegativeTest-1647988275 None] attachment_update completed successfully. Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Flow 'volume_create_manager' (0a58d46d-9031-4ee3-88fc-3b5b331bb95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe110cd-6f1b-4410-9eda-1bda845b9b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbe110cd-6f1b-4410-9eda-1bda845b9b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-114256819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2450266-f1d3-4697-bf58-60a4742cb972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527f4d447fdb42df8dd84e378137110f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:10Z,use_quota=True,user_id='9f09730c29844391b789447166f30d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8384de81-1f13-44be-83a2-7cd2abaec047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8384de81-1f13-44be-83a2-7cd2abaec047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388fda55-3b18-4a9f-81ac-d0df5bed0239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388fda55-3b18-4a9f-81ac-d0df5bed0239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2450266-f1d3-4697-bf58-60a4742cb972', 'volume_name': 'volume-d2450266-f1d3-4697-bf58-60a4742cb972', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2363936-7104-4f63-b8e6-339b43741eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2363936-7104-4f63-b8e6-339b43741eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ad5c4f-1713-4dc1-8542-ae8db9ab4b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Volume d2450266-f1d3-4697-bf58-60a4742cb972: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2450266-f1d3-4697-bf58-60a4742cb972', 'volume_size': 1} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-114256819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2450266-f1d3-4697-bf58-60a4742cb972,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527f4d447fdb42df8dd84e378137110f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:10Z,use_quota=True,user_id='9f09730c29844391b789447166f30d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Creating volume d2450266-f1d3-4697-bf58-60a4742cb972 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:50:09 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:50:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:09 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972 1073741824 Sep 09 16:50:09 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:10 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972 1073741824" returned: 0 in 0.603s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:10 devstack sudo[94790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972 Sep 09 16:50:10 devstack sudo[94790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:10 devstack sudo[94790]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:50:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88ad5c4f-1713-4dc1-8542-ae8db9ab4b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2450266-f1d3-4697-bf58-60a4742cb972', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0659ac8e-e658-46a5-9725-480501bdb1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Volume volume-d2450266-f1d3-4697-bf58-60a4742cb972 (d2450266-f1d3-4697-bf58-60a4742cb972): created successfully Sep 09 16:50:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0659ac8e-e658-46a5-9725-480501bdb1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Flow 'volume_create_manager' (0a58d46d-9031-4ee3-88fc-3b5b331bb95c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-088165fe-122d-40c9-a8ab-82055e37ff54 tempest-VolumesTransfersV355Test-937436103 None] Created volume successfully. Sep 09 16:50:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4f07809f-813c-42ad-9ed2-0f27c83668a0 tempest-VolumesTransfersV355Test-679858559 None] Transfer volume completed successfully. Sep 09 16:50:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Acquiring lock "cinder-d2450266-f1d3-4697-bf58-60a4742cb972-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:50:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Lock "cinder-d2450266-f1d3-4697-bf58-60a4742cb972-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:50:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Acquiring lock "cinder-quobyte-d2450266-f1d3-4697-bf58-60a4742cb972" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:50:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Lock "cinder-quobyte-d2450266-f1d3-4697-bf58-60a4742cb972" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:50:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3842a6f-e03c-429e-98bc-f7e66537dde5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:50:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:14 devstack sudo[94827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972 Sep 09 16:50:14 devstack sudo[94827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:15 devstack sudo[94827]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972" returned: 0 in 0.636s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:15 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972 Sep 09 16:50:15 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:15 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2450266-f1d3-4697-bf58-60a4742cb972" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Lock "cinder-quobyte-d2450266-f1d3-4697-bf58-60a4742cb972" released by "delete_volume" :: held 1.063s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Created reservations ['c0847f2e-608f-41ca-87bd-f5f1c829400a', '89d9d94c-9842-4600-ab77-18964c147868', 'c9f571bf-5339-43fd-b419-f7c871680194', '2aed53ae-ef9e-4df3-8ad6-1fa70c51b9d6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:16 devstack sudo[94842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:50:16 devstack sudo[94842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:16 devstack sudo[94842]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:16 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:50:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Deleted volume successfully. Sep 09 16:50:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3896fb8f-0b0c-41e4-a2c6-377b568324df tempest-VolumesTransfersV355Test-2134695946 None] Lock "cinder-d2450266-f1d3-4697-bf58-60a4742cb972-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Flow 'volume_create_manager' (6fef5f4a-55d4-4e4d-bb1f-66c46c5f4922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6429747-aa4d-4aa6-a299-b00146a8ffbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6429747-aa4d-4aa6-a299-b00146a8ffbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1078454554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f683986-91c4-4aec-ab52-8965ced68e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527f4d447fdb42df8dd84e378137110f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:18Z,use_quota=True,user_id='9f09730c29844391b789447166f30d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb68b412-4936-4278-a3ef-bf20e07787dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb68b412-4936-4278-a3ef-bf20e07787dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05d6ac4-e94b-4243-b723-0d741dd0835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05d6ac4-e94b-4243-b723-0d741dd0835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f683986-91c4-4aec-ab52-8965ced68e08', 'volume_name': 'volume-4f683986-91c4-4aec-ab52-8965ced68e08', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d65a8aa-61b6-4c0f-8f58-e403f1c0fcb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d65a8aa-61b6-4c0f-8f58-e403f1c0fcb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c06c457-cb17-4041-a289-c7ea05118954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Volume 4f683986-91c4-4aec-ab52-8965ced68e08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f683986-91c4-4aec-ab52-8965ced68e08', 'volume_size': 1} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1078454554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f683986-91c4-4aec-ab52-8965ced68e08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='527f4d447fdb42df8dd84e378137110f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:18Z,use_quota=True,user_id='9f09730c29844391b789447166f30d5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Creating volume 4f683986-91c4-4aec-ab52-8965ced68e08 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:50:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:18 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08 1073741824 Sep 09 16:50:18 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:18 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08 1073741824" returned: 0 in 0.765s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:19 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08 Sep 09 16:50:19 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:19 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:50:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c06c457-cb17-4041-a289-c7ea05118954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f683986-91c4-4aec-ab52-8965ced68e08', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcf1409-c3ec-4a05-b46b-7ac2540042f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Volume volume-4f683986-91c4-4aec-ab52-8965ced68e08 (4f683986-91c4-4aec-ab52-8965ced68e08): created successfully Sep 09 16:50:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fcf1409-c3ec-4a05-b46b-7ac2540042f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Flow 'volume_create_manager' (6fef5f4a-55d4-4e4d-bb1f-66c46c5f4922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-40c6a327-bb34-40f5-ad5e-88b5cb692eee tempest-VolumesTransfersV355Test-937436103 None] Created volume successfully. Sep 09 16:50:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Acquiring lock "cinder-4f683986-91c4-4aec-ab52-8965ced68e08-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:50:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Lock "cinder-4f683986-91c4-4aec-ab52-8965ced68e08-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:50:20 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=142,cinder:INSERT=25,cinder:UPDATE=142,cinder:DELETE=10 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:50:20 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=134,cinder:SELECT=146,cinder:INSERT=41,cinder:DELETE=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:50:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Acquiring lock "cinder-quobyte-4f683986-91c4-4aec-ab52-8965ced68e08" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:50:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Lock "cinder-quobyte-4f683986-91c4-4aec-ab52-8965ced68e08" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:50:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[448ee866-344f-480e-a534-1fef78cae06a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:50:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:20 devstack sudo[94957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08 Sep 09 16:50:20 devstack sudo[94957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:21 devstack sudo[94957]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08" returned: 0 in 0.541s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:21 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08 Sep 09 16:50:21 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:21 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f683986-91c4-4aec-ab52-8965ced68e08" returned: 0 in 0.341s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Lock "cinder-quobyte-4f683986-91c4-4aec-ab52-8965ced68e08" released by "delete_volume" :: held 0.932s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Created reservations ['ee38a7e4-35c6-4e88-97ab-7712e3eda2db', '7db76e77-7905-48c6-a7e0-0cc29b2b07b2', 'd69d3142-6051-4039-9695-7b596279061a', '694bbfd9-98c5-4f69-bef9-31809f280474'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:21 devstack sudo[94967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:50:21 devstack sudo[94967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:22 devstack sudo[94967]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.324s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:22 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:50:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Deleted volume successfully. Sep 09 16:50:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f19dcdf-5431-440e-a1fb-2f2d38cd2abb tempest-VolumesTransfersV355Test-2134695946 None] Lock "cinder-4f683986-91c4-4aec-ab52-8965ced68e08-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:50:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-2b8b97ad-49d3-4336-88bd-d946a92272a6 req-afc3f48e-7d00-476e-a293-a0f7bb55ec27 tempest-ServerActionsTestOtherA-40635085 None] Terminate volume connection completed successfully. Sep 09 16:50:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-2b8b97ad-49d3-4336-88bd-d946a92272a6 req-afc3f48e-7d00-476e-a293-a0f7bb55ec27 tempest-ServerActionsTestOtherA-40635085 None] Deleting attachment e96876ef-8496-4573-bd1b-a05a106a0e97. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:50:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:50:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Flow 'volume_create_manager' (ea9f13fa-13c2-46ff-a481-94f7eae388ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddc7e92-6be9-40b3-ae5a-410c93e8f814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddc7e92-6be9-40b3-ae5a-410c93e8f814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-682828465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21504839-88e3-46ca-ab80-6fa9d2be016b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b1eea6f02041ebba5a746ce200419b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:36Z,use_quota=True,user_id='53cbc1618b4348d38e734a98fd27657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b89fc2-cb9a-473b-98ea-c02187c0cbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b89fc2-cb9a-473b-98ea-c02187c0cbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67d9879-54f4-496c-8516-6d05cf7234b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:36 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 16:50:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b67d9879-54f4-496c-8516-6d05cf7234b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21504839-88e3-46ca-ab80-6fa9d2be016b', 'volume_name': 'volume-21504839-88e3-46ca-ab80-6fa9d2be016b', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe90b06-b0f8-4574-b870-9b72257fd13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe90b06-b0f8-4574-b870-9b72257fd13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b2049a-a2ef-4677-aaaf-80645812acf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Volume 21504839-88e3-46ca-ab80-6fa9d2be016b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21504839-88e3-46ca-ab80-6fa9d2be016b', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 16:50:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Trying to clone 21504839-88e3-46ca-ab80-6fa9d2be016b from image c8a55b28-da06-4b7e-8774-d16bdd532dbb at location (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 16:50:37 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 16:50:37 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Image download 20.69 MB at 20.69 MB/s Sep 09 16:50:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dddde0f-bc73-401c-99c8-119e758102a0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:50:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:37 devstack sudo[95047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD Sep 09 16:50:37 devstack sudo[95047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:37 devstack sudo[95047]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:37 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Temporary image c8a55b28-da06-4b7e-8774-d16bdd532dbb is fetched for user 53cbc1618b4348d38e734a98fd27657a. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 16:50:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5442a39c-dbd2-4190-916e-d4a5e1323615]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:50:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:38 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD Sep 09 16:50:38 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:38 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD" returned: 0 in 0.569s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-682828465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21504839-88e3-46ca-ab80-6fa9d2be016b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61b1eea6f02041ebba5a746ce200419b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:36Z,use_quota=True,user_id='53cbc1618b4348d38e734a98fd27657a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Creating volume 21504839-88e3-46ca-ab80-6fa9d2be016b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:50:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:50:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:38 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b 1073741824 Sep 09 16:50:38 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:39 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b 1073741824" returned: 0 in 0.838s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:39 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b Sep 09 16:50:39 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:39 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b" returned: 0 in 0.303s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:50:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:39 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Attempting download of c8a55b28-da06-4b7e-8774-d16bdd532dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}])) to volume 21504839-88e3-46ca-ab80-6fa9d2be016b. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1197}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ffbdd1-45eb-4c42-98f5-1676ac086cfe]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_mnagyvf_ {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:40 devstack sudo[95070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_mnagyvf_ Sep 09 16:50:40 devstack sudo[95070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Flow 'volume_create_manager' (911196b0-684d-4da1-99b3-f90a9cfd32a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3e5ded-7fee-402d-b1b6-817eceba5003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3e5ded-7fee-402d-b1b6-817eceba5003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-385713059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee8e95f70004ef2bb1564b26b6f0206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:40Z,use_quota=True,user_id='2e998a5011f2423098b5e137d9debc1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cda7fa-fa91-4398-9947-35771f8fe663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63cda7fa-fa91-4398-9947-35771f8fe663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7127c90-036c-4236-9004-86b1517e78dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7127c90-036c-4236-9004-86b1517e78dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f', 'volume_name': 'volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90f44ea-e675-428c-ab48-c2b612628b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e90f44ea-e675-428c-ab48-c2b612628b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4a508f-fce3-498e-a2ee-aeabc796aa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:40 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Volume d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f', 'volume_size': 1} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-385713059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ee8e95f70004ef2bb1564b26b6f0206',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:40Z,use_quota=True,user_id='2e998a5011f2423098b5e137d9debc1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Creating volume d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:40 devstack sudo[95070]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:50:40 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_mnagyvf_" returned: 0 in 0.589s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_mnagyvf_ {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:40 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f 1073741824 Sep 09 16:50:40 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:40 devstack sudo[95078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_mnagyvf_ Sep 09 16:50:40 devstack sudo[95078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:41 devstack sudo[95078]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_mnagyvf_" returned: 1 in 0.389s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_mnagyvf_' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9535989b-dba3-4811-9218-5381dc420995]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:41 devstack sudo[95088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD Sep 09 16:50:41 devstack sudo[95088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:41 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f 1073741824" returned: 0 in 0.709s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:41 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f Sep 09 16:50:41 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:41 devstack sudo[95088]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] c8a55b28-da06-4b7e-8774-d16bdd532dbb was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:41 devstack sudo[95098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b Sep 09 16:50:41 devstack sudo[95098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:41 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4a508f-fce3-498e-a2ee-aeabc796aa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a1b7a7-60c7-443f-80ad-7c599e2e42d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:41 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Volume volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f (d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f): created successfully Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a1b7a7-60c7-443f-80ad-7c599e2e42d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Flow 'volume_create_manager' (911196b0-684d-4da1-99b3-f90a9cfd32a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e4d5256f-f68a-446c-b957-1cbda5309725 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Created volume successfully. Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Acquiring lock "cinder-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Lock "cinder-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Acquiring lock "cinder-quobyte-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Lock "cinder-quobyte-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46d155a-8db0-4566-807a-1b2f87a35c71]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:44 devstack sudo[95098]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b" returned: 0 in 3.058s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_ktkll_d0devstack@QuobyteHD, size 112.00 MB, duration 3.06 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:50:44 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Converted 112.00 MB image at 36.61 MB/s Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:44 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f Sep 09 16:50:44 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:44 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b 1G Sep 09 16:50:44 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Flow 'volume_create_manager' (77c936a4-c6d6-4d52-87b3-f2bdadced7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d740b1-21ec-4d4e-8240-43e82b947c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74d740b1-21ec-4d4e-8240-43e82b947c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-475383062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2508d9-8ff7-48bf-811f-2c525003183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a783e155230549ffafc7bc17c8faff56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:45Z,use_quota=True,user_id='375d9d2cf2e7481090ddabe058b710ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415ff73a-683d-4abc-be29-dc1d894f2835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415ff73a-683d-4abc-be29-dc1d894f2835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf0c712-188c-4680-b18e-dfadb3992340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddf0c712-188c-4680-b18e-dfadb3992340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2508d9-8ff7-48bf-811f-2c525003183d', 'volume_name': 'volume-cd2508d9-8ff7-48bf-811f-2c525003183d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4071536-c271-4a19-a4fd-c8b0f9002276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4071536-c271-4a19-a4fd-c8b0f9002276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22ad929-6128-415f-8ced-31dcd58f6f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Volume cd2508d9-8ff7-48bf-811f-2c525003183d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2508d9-8ff7-48bf-811f-2c525003183d', 'volume_size': 1} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-475383062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2508d9-8ff7-48bf-811f-2c525003183d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a783e155230549ffafc7bc17c8faff56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:45Z,use_quota=True,user_id='375d9d2cf2e7481090ddabe058b710ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Creating volume cd2508d9-8ff7-48bf-811f-2c525003183d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:44 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:50:44 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:50:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:45 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d 1073741824 Sep 09 16:50:45 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:45 devstack sudo[95147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:50:45 devstack sudo[95147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:45 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f Sep 09 16:50:45 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:45 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b 1G" returned: 0 in 0.438s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Downloaded image c8a55b28-da06-4b7e-8774-d16bdd532dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}])) to volume 21504839-88e3-46ca-ab80-6fa9d2be016b successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1242}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Temporary image c8a55b28-da06-4b7e-8774-d16bdd532dbb for user 53cbc1618b4348d38e734a98fd27657a is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Marking volume 21504839-88e3-46ca-ab80-6fa9d2be016b as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1146}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Copying metadata from image c8a55b28-da06-4b7e-8774-d16bdd532dbb to 21504839-88e3-46ca-ab80-6fa9d2be016b. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Creating volume glance metadata for volume 21504839-88e3-46ca-ab80-6fa9d2be016b backed by image c8a55b28-da06-4b7e-8774-d16bdd532dbb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 16:50:45 devstack sudo[95147]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b2049a-a2ef-4677-aaaf-80645812acf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21504839-88e3-46ca-ab80-6fa9d2be016b', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e27f98-1835-47d3-8aae-6206a0a6c327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:50:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Volume volume-21504839-88e3-46ca-ab80-6fa9d2be016b (21504839-88e3-46ca-ab80-6fa9d2be016b): created successfully Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e27f98-1835-47d3-8aae-6206a0a6c327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Flow 'volume_create_manager' (ea9f13fa-13c2-46ff-a481-94f7eae388ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c5db06d3-26bb-4762-9f33-ebeda29977c5 tempest-ServerActionsTestOtherA-40635085 None] Created volume successfully. Sep 09 16:50:45 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Lock "cinder-quobyte-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f" released by "delete_volume" :: held 0.949s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Created reservations ['4d94f72f-ab7a-4391-89d5-ef44dfd0e128', 'b0649310-ae73-42e0-82fb-443a5ddee044', '18330994-ddb2-44df-b94d-de4506150c71', 'f29ec428-bb51-4150-b109-408c9c7a5861'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:50:45 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d 1073741824" returned: 0 in 0.598s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:45 devstack sudo[95159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:50:45 devstack sudo[95159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:45 devstack sudo[95160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d Sep 09 16:50:45 devstack sudo[95160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:45 devstack sudo[95159]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:50:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Deleted volume successfully. Sep 09 16:50:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7ecaf64d-75ee-4e5c-8142-f282357a02b1 tempest-VolumeQuotasNegativeTestJSON-943791777 None] Lock "cinder-d7ee1cfe-6f1e-468b-9b04-0f14e23dfd3f-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:50:45 devstack sudo[95160]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:50:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b22ad929-6128-415f-8ced-31dcd58f6f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2508d9-8ff7-48bf-811f-2c525003183d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ec51bc-6a44-46ec-857e-55577b903819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Volume volume-cd2508d9-8ff7-48bf-811f-2c525003183d (cd2508d9-8ff7-48bf-811f-2c525003183d): created successfully Sep 09 16:50:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35ec51bc-6a44-46ec-857e-55577b903819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Flow 'volume_create_manager' (77c936a4-c6d6-4d52-87b3-f2bdadced7a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a91ea55d-537c-45ad-af15-35ec66ad783f tempest-VolumesActionsTest-1845823516 None] Created volume successfully. Sep 09 16:50:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-774331f1-e9bc-4135-bf68-864c2972b483 req-1533d57e-c8bf-4193-b3c4-ebbb2a27649f tempest-AttachVolumeNegativeTest-1647988275 None] Terminate volume connection completed successfully. Sep 09 16:50:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-774331f1-e9bc-4135-bf68-864c2972b483 req-1533d57e-c8bf-4193-b3c4-ebbb2a27649f tempest-AttachVolumeNegativeTest-1647988275 None] Deleting attachment 7b986433-8b04-460c-a1bb-9d2646261a9e. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:50:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-aa34e72c-b0db-452d-ad53-98ede42faeb9 req-78e7ffb6-2e16-4e51-85bb-8bc5afe78a40 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-aa34e72c-b0db-452d-ad53-98ede42faeb9 req-78e7ffb6-2e16-4e51-85bb-8bc5afe78a40 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-aa34e72c-b0db-452d-ad53-98ede42faeb9 req-78e7ffb6-2e16-4e51-85bb-8bc5afe78a40 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-aa34e72c-b0db-452d-ad53-98ede42faeb9 req-78e7ffb6-2e16-4e51-85bb-8bc5afe78a40 tempest-ServerActionsTestOtherA-40635085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-21504839-88e3-46ca-ab80-6fa9d2be016b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b39a8598-4863-4150-a8ea-423196961dac', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:50:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-aa34e72c-b0db-452d-ad53-98ede42faeb9 req-78e7ffb6-2e16-4e51-85bb-8bc5afe78a40 tempest-ServerActionsTestOtherA-40635085 None] attachment_update completed successfully. Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Flow 'volume_create_manager' (52d678a2-45f9-48a5-86de-3d7f735b5e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e055a9-1b13-4871-8aab-9bbc80c87447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84e055a9-1b13-4871-8aab-9bbc80c87447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-477189795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b5b8a5-7c4b-4681-8c00-9b1e337feb2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111ab2f94f9485f8acc84453661edd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:58Z,use_quota=True,user_id='96fd4154faee4e51b20c2e871274bd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c207fb-6b23-4b5f-97cb-78b145467664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06c207fb-6b23-4b5f-97cb-78b145467664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d081b1cf-ac88-4691-b4d7-9e152a7cc992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d081b1cf-ac88-4691-b4d7-9e152a7cc992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12b5b8a5-7c4b-4681-8c00-9b1e337feb2f', 'volume_name': 'volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5fe495-1f97-4304-84de-2546d5e6e355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b5fe495-1f97-4304-84de-2546d5e6e355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4297fc4c-ea4e-4f7a-923b-ffea450debaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:50:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Volume 12b5b8a5-7c4b-4681-8c00-9b1e337feb2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f', 'volume_size': 1} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-477189795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b5b8a5-7c4b-4681-8c00-9b1e337feb2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5111ab2f94f9485f8acc84453661edd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:50:58Z,use_quota=True,user_id='96fd4154faee4e51b20c2e871274bd51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Creating volume 12b5b8a5-7c4b-4681-8c00-9b1e337feb2f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:50:58 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:50:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:58 devstack sudo[95717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f 1073741824 Sep 09 16:50:58 devstack sudo[95717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:50:59 devstack sudo[95717]: pam_unix(sudo:session): session closed for user root Sep 09 16:50:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f 1073741824" returned: 0 in 1.039s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:50:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:50:59 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f Sep 09 16:50:59 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:51:00 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4297fc4c-ea4e-4f7a-923b-ffea450debaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee335216-f270-4e80-8ed6-99fe56108ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:51:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Volume volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f (12b5b8a5-7c4b-4681-8c00-9b1e337feb2f): created successfully Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee335216-f270-4e80-8ed6-99fe56108ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Flow 'volume_create_manager' (52d678a2-45f9-48a5-86de-3d7f735b5e71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:51:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b52a607d-1d59-4f55-8dca-869fd7a10863 tempest-VolumesServicesTestJSON-1079444287 None] Created volume successfully. Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7af15401-62a8-4593-8912-06e107164435 tempest-VolumesActionsTest-1845823516 None] Acquiring lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d" by "attach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Acquiring lock "cinder-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7af15401-62a8-4593-8912-06e107164435 tempest-VolumesActionsTest-1845823516 None] Lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d" acquired by "attach_volume" :: waited 0.076s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Lock "cinder-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Acquiring lock "cinder-quobyte-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Lock "cinder-quobyte-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:51:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7af15401-62a8-4593-8912-06e107164435 tempest-VolumesActionsTest-1845823516 None] Attaching volume cd2508d9-8ff7-48bf-811f-2c525003183d to instance 6622982b-868b-4c1d-880a-88d101924a2b at mountpoint /dev/vdb on host None. Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2efb3f-95c9-41f3-847a-0971048bf8b8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:51:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:51:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7af15401-62a8-4593-8912-06e107164435 tempest-VolumesActionsTest-1845823516 None] Attach volume completed successfully. Sep 09 16:51:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7af15401-62a8-4593-8912-06e107164435 tempest-VolumesActionsTest-1845823516 None] Lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d" released by "attach_volume" :: held 0.304s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:51:01 devstack sudo[95729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f Sep 09 16:51:01 devstack sudo[95729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:51:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b42cbf36-e4dd-4a6c-8b4a-186ccbed2f77 tempest-VolumesActionsTest-1845823516 None] Acquiring lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:51:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b42cbf36-e4dd-4a6c-8b4a-186ccbed2f77 tempest-VolumesActionsTest-1845823516 None] Lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:51:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b42cbf36-e4dd-4a6c-8b4a-186ccbed2f77 tempest-VolumesActionsTest-1845823516 None] Detaching volume cd2508d9-8ff7-48bf-811f-2c525003183d from instance 6622982b-868b-4c1d-880a-88d101924a2b. Sep 09 16:51:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b42cbf36-e4dd-4a6c-8b4a-186ccbed2f77 tempest-VolumesActionsTest-1845823516 None] Detach volume completed successfully. Sep 09 16:51:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b42cbf36-e4dd-4a6c-8b4a-186ccbed2f77 tempest-VolumesActionsTest-1845823516 None] Lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d-detach_volume" released by "detach_volume" :: held 0.198s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:51:01 devstack sudo[95729]: pam_unix(sudo:session): session closed for user root Sep 09 16:51:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f" returned: 0 in 0.776s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:51:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:51:01 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f Sep 09 16:51:01 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:51:02 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Sep 09 16:51:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f" returned: 0 in 0.681s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:51:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Lock "cinder-quobyte-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f" released by "delete_volume" :: held 1.553s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:51:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Created reservations ['737ea9b2-49a9-46f0-984b-0f6ba66bb5c5', 'b37766eb-1139-4349-8261-b03737f80e76', 'c33a35df-2d45-4f68-abff-b9899108a78a', '7f8660a5-b5fe-427b-b3bb-047bf63d7e98'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:51:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:51:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:51:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:51:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:51:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:51:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:51:02 devstack sudo[95744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:51:02 devstack sudo[95744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:51:03 devstack sudo[95744]: pam_unix(sudo:session): session closed for user root Sep 09 16:51:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.599s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:51:03 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:51:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Deleted volume successfully. Sep 09 16:51:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-199c14e8-4518-4caa-acbd-51d8ae6ddddb tempest-VolumesServicesTestJSON-1079444287 None] Lock "cinder-12b5b8a5-7c4b-4681-8c00-9b1e337feb2f-delete_volume" released by "delete_volume" :: held 2.630s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:51:12 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=48,cinder:INSERT=13,cinder:UPDATE=49,cinder:DELETE=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:51:13 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=42,cinder:INSERT=18,cinder:UPDATE=34,cinder:DELETE=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:51:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-cd8fdc4f-1c8d-4f8e-964b-ee1299308d43 req-b018a1c0-dff2-44a2-917b-779a3d3d987e tempest-ServerActionsTestOtherA-40635085 None] Terminate volume connection completed successfully. Sep 09 16:51:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-cd8fdc4f-1c8d-4f8e-964b-ee1299308d43 req-b018a1c0-dff2-44a2-917b-779a3d3d987e tempest-ServerActionsTestOtherA-40635085 None] Deleting attachment b39a8598-4863-4150-a8ea-423196961dac. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:51:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-cd8fdc4f-1c8d-4f8e-964b-ee1299308d43 req-3c5765b5-72f9-4667-a336-445ab45a6105 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:51:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-cd8fdc4f-1c8d-4f8e-964b-ee1299308d43 req-3c5765b5-72f9-4667-a336-445ab45a6105 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:51:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-cd8fdc4f-1c8d-4f8e-964b-ee1299308d43 req-3c5765b5-72f9-4667-a336-445ab45a6105 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:51:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-cd8fdc4f-1c8d-4f8e-964b-ee1299308d43 req-3c5765b5-72f9-4667-a336-445ab45a6105 tempest-ServerActionsTestOtherA-40635085 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-21504839-88e3-46ca-ab80-6fa9d2be016b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37934795-94a6-4c8d-9414-6c85be9851f7', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:51:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-cd8fdc4f-1c8d-4f8e-964b-ee1299308d43 req-3c5765b5-72f9-4667-a336-445ab45a6105 tempest-ServerActionsTestOtherA-40635085 None] attachment_update completed successfully. Sep 09 16:51:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aecc9d98-a609-4f9f-ad64-a872c48c3395 tempest-VolumesActionsTest-1845823516 None] Acquiring lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d" by "attach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:51:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aecc9d98-a609-4f9f-ad64-a872c48c3395 tempest-VolumesActionsTest-1845823516 None] Lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d" acquired by "attach_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:51:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aecc9d98-a609-4f9f-ad64-a872c48c3395 tempest-VolumesActionsTest-1845823516 None] Attaching volume cd2508d9-8ff7-48bf-811f-2c525003183d to instance edec9288-5777-4291-b02d-e8cc7053e60b at mountpoint /dev/vdb on host None. Sep 09 16:51:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aecc9d98-a609-4f9f-ad64-a872c48c3395 tempest-VolumesActionsTest-1845823516 None] Attach volume completed successfully. Sep 09 16:51:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aecc9d98-a609-4f9f-ad64-a872c48c3395 tempest-VolumesActionsTest-1845823516 None] Lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d" released by "attach_volume" :: held 0.151s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:51:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d525953f-52c6-4b33-9f64-636ae7ed47d6 tempest-VolumesActionsTest-1845823516 None] Acquiring lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:51:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d525953f-52c6-4b33-9f64-636ae7ed47d6 tempest-VolumesActionsTest-1845823516 None] Lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d-detach_volume" acquired by "detach_volume" :: waited 0.064s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:51:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d525953f-52c6-4b33-9f64-636ae7ed47d6 tempest-VolumesActionsTest-1845823516 None] Detaching volume cd2508d9-8ff7-48bf-811f-2c525003183d from instance edec9288-5777-4291-b02d-e8cc7053e60b. Sep 09 16:51:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d525953f-52c6-4b33-9f64-636ae7ed47d6 tempest-VolumesActionsTest-1845823516 None] Detach volume completed successfully. Sep 09 16:51:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d525953f-52c6-4b33-9f64-636ae7ed47d6 tempest-VolumesActionsTest-1845823516 None] Lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d-detach_volume" released by "detach_volume" :: held 0.282s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:51:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:51:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:51:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeebc58d-ded7-4ba3-9c5d-d57e76795919]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:51:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:51:35 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d Sep 09 16:51:35 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:51:36 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Sep 09 16:51:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d" returned: 0 in 0.425s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:51:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7a4eea-e31a-487b-bc04-c86a540bcf23]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:51:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:51:36 devstack sudo[96540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d Sep 09 16:51:36 devstack sudo[96540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:51:36 devstack sudo[96540]: pam_unix(sudo:session): session closed for user root Sep 09 16:51:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d" returned: 0 in 0.473s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:51:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.8ab0efc3-64c0-45ef-8add-08caa42e52ef2zn29960.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:51:36 devstack sudo[96545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.8ab0efc3-64c0-45ef-8add-08caa42e52ef2zn29960.img Sep 09 16:51:36 devstack sudo[96545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:51:37 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=18,cinder:UPDATE=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:51:43 devstack sudo[96545]: pam_unix(sudo:session): session closed for user root Sep 09 16:51:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.8ab0efc3-64c0-45ef-8add-08caa42e52ef2zn29960.img" returned: 0 in 6.892s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:51:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[97d013e2-482b-44e8-a4bb-9694d9933d8f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:51:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:51:43 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d Sep 09 16:51:43 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:51:44 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Sep 09 16:51:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d" returned: 0 in 0.691s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:51:44 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d, size 1024.00 MB, duration 6.89 sec, destination /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.8ab0efc3-64c0-45ef-8add-08caa42e52ef2zn29960.img {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:51:44 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Converted 1024.00 MB image at 148.53 MB/s Sep 09 16:51:44 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] 8ab0efc3-64c0-45ef-8add-08caa42e52ef was raw, no need to convert to raw {{(pid=87498) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:51:45 devstack sudo[96572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:51:45 devstack sudo[96572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:51:45 devstack sudo[96572]: pam_unix(sudo:session): session closed for user root Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.497s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Flow 'volume_create_manager' (93b52144-69f5-4a62-935f-122500ceeabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03c2d0d-166d-4137-8185-e5fdbbe416ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a03c2d0d-166d-4137-8185-e5fdbbe416ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-350293949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66baa217-ee85-4a8b-982d-d1eda8c8bf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc48979dfa747098df5d387cd8bf336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:51:46Z,use_quota=True,user_id='0d3a301f2b2345e5af689aa76bb10838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d14d38-c59d-4100-911d-7db705152f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d14d38-c59d-4100-911d-7db705152f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5b1cfe-ca92-48a7-a2fc-64f84227760d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d5b1cfe-ca92-48a7-a2fc-64f84227760d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66baa217-ee85-4a8b-982d-d1eda8c8bf15', 'volume_name': 'volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2774cc-d9d9-4a11-b464-40fa51ba365f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b2774cc-d9d9-4a11-b464-40fa51ba365f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c829770-d04e-43a1-a075-89f2e9f5dc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:51:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Volume 66baa217-ee85-4a8b-982d-d1eda8c8bf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15', 'volume_size': 1} Sep 09 16:51:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:51:55 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:51:55 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.854s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Uploaded volume to glance image-id: 8ab0efc3-64c0-45ef-8add-08caa42e52ef. {{(pid=87498) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.430s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-350293949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66baa217-ee85-4a8b-982d-d1eda8c8bf15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc48979dfa747098df5d387cd8bf336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:51:46Z,use_quota=True,user_id='0d3a301f2b2345e5af689aa76bb10838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Creating volume 66baa217-ee85-4a8b-982d-d1eda8c8bf15 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:52:06 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f067e69e-d3ef-44d3-aaf8-a9078732e14d tempest-VolumesActionsTest-1845823516 None] Copy volume to image completed successfully. Sep 09 16:52:06 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15 1073741824 Sep 09 16:52:06 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:06 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15 1073741824" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:06 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15 Sep 09 16:52:06 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:07 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:52:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c829770-d04e-43a1-a075-89f2e9f5dc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa5ec08-8e17-4a5f-bbcb-6a736d3a10d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Volume volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15 (66baa217-ee85-4a8b-982d-d1eda8c8bf15): created successfully Sep 09 16:52:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa5ec08-8e17-4a5f-bbcb-6a736d3a10d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Flow 'volume_create_manager' (93b52144-69f5-4a62-935f-122500ceeabf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2692b6de-135d-4145-b781-21d9bfb25ae1 tempest-AttachVolumeNegativeTest-1647988275 None] Created volume successfully. Sep 09 16:52:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d794cc6c-9676-4c97-a173-8a247a6fb227]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:08 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d Sep 09 16:52:08 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-60105d86-e892-49ba-ac8f-facd173bf5e1 req-4703b16e-617d-4c4f-bd2f-992eba56d632 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:08 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d" returned: 0 in 0.438s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f548161-75c8-4e34-ac3d-420da2683473]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:08 devstack sudo[96686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d Sep 09 16:52:08 devstack sudo[96686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:09 devstack sudo[96686]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:09 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img Sep 09 16:52:09 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:15 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img" returned: 0 in 6.197s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4a9131-9c3f-4752-b632-8b3a457c9849]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:15 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d Sep 09 16:52:15 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:16 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d" returned: 0 in 0.674s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:16 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d, size 1024.00 MB, duration 6.20 sec, destination /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:52:16 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Converted 1024.00 MB image at 165.19 MB/s Sep 09 16:52:16 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] 0bd26e49-50dd-48fc-b098-58203ffc8155 was raw, converting to qcow2 {{(pid=87498) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 09 16:52:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e290246-9cda-4296-991f-7ee0db1263ee]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:16 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img Sep 09 16:52:16 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:16 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:16 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img Sep 09 16:52:16 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:16 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img" returned: 1 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:52:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img /opt/stack/data/cinder/conversion/vol_upload_6gd0luij {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:16 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img /opt/stack/data/cinder/conversion/vol_upload_6gd0luij Sep 09 16:52:16 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-3e5fd0a4-2454-4c29-b07e-fc3f99c81de7 tempest-ServerActionsTestOtherA-40635085 None] Terminate volume connection completed successfully. Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-3e5fd0a4-2454-4c29-b07e-fc3f99c81de7 tempest-ServerActionsTestOtherA-40635085 None] Deleting attachment 37934795-94a6-4c8d-9414-6c85be9851f7. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:52:17 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img /opt/stack/data/cinder/conversion/vol_upload_6gd0luij" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Image conversion details: src /opt/stack/data/cinder/conversion/cd2508d9-8ff7-48bf-811f-2c525003183d.temp_image.0bd26e49-50dd-48fc-b098-58203ffc8155dwxi0f83.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_6gd0luij {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:52:17 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9120ce38-7c79-493f-adae-a73b8ca2b11c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6gd0luij {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "cinder-21504839-88e3-46ca-ab80-6fa9d2be016b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Lock "cinder-21504839-88e3-46ca-ab80-6fa9d2be016b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "cinder-quobyte-21504839-88e3-46ca-ab80-6fa9d2be016b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:17 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6gd0luij Sep 09 16:52:17 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Lock "cinder-quobyte-21504839-88e3-46ca-ab80-6fa9d2be016b" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84c0bb3-725a-4a3f-ac3f-855b0ec9ef33]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:17 devstack sudo[96771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b Sep 09 16:52:17 devstack sudo[96771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:17 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_6gd0luij" returned: 0 in 0.566s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:18 devstack sudo[96771]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b" returned: 0 in 0.827s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:18 devstack sudo[96780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b Sep 09 16:52:18 devstack sudo[96780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:18 devstack sudo[96780]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-21504839-88e3-46ca-ab80-6fa9d2be016b" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Lock "cinder-quobyte-21504839-88e3-46ca-ab80-6fa9d2be016b" released by "delete_volume" :: held 1.223s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG cinder.quota [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Created reservations ['4d73d592-3cc0-4455-85d3-43ea85fe538c', '09c56323-041f-492a-b686-102b5adb8e37', '7abdeb76-1d84-4c63-a867-0848fc43e1aa', '3f809256-28d3-44d6-852c-ea7f7ae0bc7e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:18 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:52:18 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:19 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.325s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG cinder.manager [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:52:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Deleted volume successfully. Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-a25b49a8-bd12-45c1-bc88-cb328d0ef974 req-05e9a932-e5e4-40c9-8161-5d71ce3b0af6 tempest-ServerActionsTestOtherA-40635085 None] Lock "cinder-21504839-88e3-46ca-ab80-6fa9d2be016b-delete_volume" released by "delete_volume" :: held 1.975s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "cinder-2e12b49d-f852-4874-8dc0-4601add3c653-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Lock "cinder-2e12b49d-f852-4874-8dc0-4601add3c653-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "cinder-quobyte-2e12b49d-f852-4874-8dc0-4601add3c653" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Lock "cinder-quobyte-2e12b49d-f852-4874-8dc0-4601add3c653" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca26f78-8b85-4f94-a278-662a3135aad7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:19 devstack sudo[96796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653 Sep 09 16:52:19 devstack sudo[96796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.619s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Uploaded volume to glance image-id: 0bd26e49-50dd-48fc-b098-58203ffc8155. {{(pid=87498) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-60105d86-e892-49ba-ac8f-facd173bf5e1 req-4703b16e-617d-4c4f-bd2f-992eba56d632 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.344s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-60105d86-e892-49ba-ac8f-facd173bf5e1 req-4703b16e-617d-4c4f-bd2f-992eba56d632 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-14efde4e-fca9-4935-a9d5-cac449479a7d tempest-VolumesActionsTest-1845823516 None] Copy volume to image completed successfully. Sep 09 16:52:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-60105d86-e892-49ba-ac8f-facd173bf5e1 req-4703b16e-617d-4c4f-bd2f-992eba56d632 tempest-AttachVolumeNegativeTest-1647988275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ed332e4f-bc65-475a-b3e4-a7b7103759aa', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:52:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-60105d86-e892-49ba-ac8f-facd173bf5e1 req-4703b16e-617d-4c4f-bd2f-992eba56d632 tempest-AttachVolumeNegativeTest-1647988275 None] attachment_update completed successfully. Sep 09 16:52:20 devstack sudo[96796]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653" returned: 0 in 0.650s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:20 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653 Sep 09 16:52:20 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:20 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e12b49d-f852-4874-8dc0-4601add3c653" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Lock "cinder-quobyte-2e12b49d-f852-4874-8dc0-4601add3c653" released by "delete_volume" :: held 1.210s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:20 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Created reservations ['0c725fb7-709a-4c47-9a20-3cd517b616ca', 'd6152aa0-5f82-440d-b398-8363e668b985', '189f27ca-f7e9-4aa9-8366-2518147e78de', '2c58474d-35c7-4fd1-aee9-bd506bf1f56b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:21 devstack sudo[97214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:52:21 devstack sudo[97214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Acquiring lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:21 devstack sudo[97214]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:52:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Deleted volume successfully. Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Acquiring lock "cinder-quobyte-cd2508d9-8ff7-48bf-811f-2c525003183d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-621c280b-9168-45e9-8838-38e93e0467c4 tempest-ServerActionsTestOtherA-40635085 None] Lock "cinder-2e12b49d-f852-4874-8dc0-4601add3c653-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Lock "cinder-quobyte-cd2508d9-8ff7-48bf-811f-2c525003183d" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[294ff0d0-0887-4902-b31d-8a81a6df95e9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:21 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d Sep 09 16:52:21 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:21 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:22 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d Sep 09 16:52:22 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:22 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cd2508d9-8ff7-48bf-811f-2c525003183d" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Lock "cinder-quobyte-cd2508d9-8ff7-48bf-811f-2c525003183d" released by "delete_volume" :: held 0.830s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:22 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Created reservations ['197b0691-7b58-40b3-878d-bf8e13952d67', '96640bc2-f906-4257-b5c6-87555f36ec0c', '05152dd8-3c93-4b11-a71c-b6a826b3818d', 'c26d533f-d98e-441a-a916-89099f21d9b0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:52:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:22 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:52:22 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:23 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:23 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:52:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Deleted volume successfully. Sep 09 16:52:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b37eacd2-0528-4c81-aede-6f19bc4c0c3b tempest-VolumesActionsTest-1845823516 None] Lock "cinder-cd2508d9-8ff7-48bf-811f-2c525003183d-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-4e01ed50-c491-442f-9050-2e0b9428bffa req-413bcd61-b870-4449-9373-0346c0b5cc40 tempest-AttachVolumeNegativeTest-1647988275 None] Terminate volume connection completed successfully. Sep 09 16:52:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-4e01ed50-c491-442f-9050-2e0b9428bffa req-413bcd61-b870-4449-9373-0346c0b5cc40 tempest-AttachVolumeNegativeTest-1647988275 None] Deleting attachment ed332e4f-bc65-475a-b3e4-a7b7103759aa. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:52:33 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:INSERT=9,cinder:UPDATE=27,cinder:DELETE=3,cinder:SELECT=32 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:52:33 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=23,cinder:UPDATE=32,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (e719b433-a4cf-4860-b8ee-e068d3f8c010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eda51ca-190b-4a42-b30c-d7b012acfeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eda51ca-190b-4a42-b30c-d7b012acfeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-804344528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f27e163-3538-4534-be9a-701bdf4721a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:37Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433adf27-7775-4e13-96ae-6ff34abc1b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (433adf27-7775-4e13-96ae-6ff34abc1b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c083146-ff74-4abe-948a-504fd29d01b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c083146-ff74-4abe-948a-504fd29d01b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f27e163-3538-4534-be9a-701bdf4721a6', 'volume_name': 'volume-5f27e163-3538-4534-be9a-701bdf4721a6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f742771-0258-454a-9fd3-c76f0bd67bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f742771-0258-454a-9fd3-c76f0bd67bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd794d88-6d37-4922-b720-7175bbc47282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Volume 5f27e163-3538-4534-be9a-701bdf4721a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f27e163-3538-4534-be9a-701bdf4721a6', 'volume_size': 1} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-804344528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f27e163-3538-4534-be9a-701bdf4721a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:37Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Creating volume 5f27e163-3538-4534-be9a-701bdf4721a6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:52:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:52:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:37 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6 1073741824 Sep 09 16:52:37 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:38 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6 1073741824" returned: 0 in 0.604s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:38 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6 Sep 09 16:52:38 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:38 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6" returned: 0 in 0.455s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:52:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd794d88-6d37-4922-b720-7175bbc47282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f27e163-3538-4534-be9a-701bdf4721a6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4da22f4-8bfe-4f02-a200-96e5427a05f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Volume volume-5f27e163-3538-4534-be9a-701bdf4721a6 (5f27e163-3538-4534-be9a-701bdf4721a6): created successfully Sep 09 16:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4da22f4-8bfe-4f02-a200-96e5427a05f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (e719b433-a4cf-4860-b8ee-e068d3f8c010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-416b9949-96e6-4ef1-91a2-0ad461bb55d5 tempest-VolumesActionsTest-1389135844 None] Created volume successfully. Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (79a04c17-cbee-4fe6-bcb3-8a463fe4ee58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d77e0d-d0d9-4f29-9fc1-752e1927010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a8c810c8-eb02-48aa-b24f-9c2cb2a6aa40 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6" by "attach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28d77e0d-d0d9-4f29-9fc1-752e1927010e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1146262106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b48f708-112e-48d4-911d-16141e549acd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:39Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd71b94-d0fd-49e2-8efe-de16a1d30cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfd71b94-d0fd-49e2-8efe-de16a1d30cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc40cb5b-2ff2-41c7-afff-1dac627654f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc40cb5b-2ff2-41c7-afff-1dac627654f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b48f708-112e-48d4-911d-16141e549acd', 'volume_name': 'volume-6b48f708-112e-48d4-911d-16141e549acd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6efa2e-55cc-4aee-b36f-79f56ca28686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6efa2e-55cc-4aee-b36f-79f56ca28686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65db4025-f6a3-43b1-a0a4-a63a96497f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Volume 6b48f708-112e-48d4-911d-16141e549acd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b48f708-112e-48d4-911d-16141e549acd', 'volume_size': 1} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1146262106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b48f708-112e-48d4-911d-16141e549acd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:39Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Creating volume 6b48f708-112e-48d4-911d-16141e549acd {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:52:39 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:39 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd 1073741824 Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a8c810c8-eb02-48aa-b24f-9c2cb2a6aa40 tempest-VolumesActionsTest-1389135844 None] Lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6" acquired by "attach_volume" :: waited 0.152s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:39 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a8c810c8-eb02-48aa-b24f-9c2cb2a6aa40 tempest-VolumesActionsTest-1389135844 None] Attaching volume 5f27e163-3538-4534-be9a-701bdf4721a6 to instance 2a1224da-8c86-4777-b190-69fb36907433 at mountpoint /dev/vdb on host None. Sep 09 16:52:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a8c810c8-eb02-48aa-b24f-9c2cb2a6aa40 tempest-VolumesActionsTest-1389135844 None] Attach volume completed successfully. Sep 09 16:52:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a8c810c8-eb02-48aa-b24f-9c2cb2a6aa40 tempest-VolumesActionsTest-1389135844 None] Lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6" released by "attach_volume" :: held 0.160s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:40 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd 1073741824" returned: 0 in 1.014s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:40 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd Sep 09 16:52:40 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6f8431f3-d1a2-4ee4-8ccf-dfd75adb55bc tempest-VolumesActionsTest-609580949 None] Terminate volume connection completed successfully. Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f8431f3-d1a2-4ee4-8ccf-dfd75adb55bc tempest-VolumesActionsTest-609580949 None] Acquiring lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f8431f3-d1a2-4ee4-8ccf-dfd75adb55bc tempest-VolumesActionsTest-609580949 None] Lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6f8431f3-d1a2-4ee4-8ccf-dfd75adb55bc tempest-VolumesActionsTest-609580949 None] Detaching volume 5f27e163-3538-4534-be9a-701bdf4721a6 from instance 2a1224da-8c86-4777-b190-69fb36907433. Sep 09 16:52:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6f8431f3-d1a2-4ee4-8ccf-dfd75adb55bc tempest-VolumesActionsTest-609580949 None] Detach volume completed successfully. Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f8431f3-d1a2-4ee4-8ccf-dfd75adb55bc tempest-VolumesActionsTest-609580949 None] Lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:41 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd" returned: 0 in 0.809s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65db4025-f6a3-43b1-a0a4-a63a96497f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b48f708-112e-48d4-911d-16141e549acd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeeced4a-ae0e-48ab-a272-90cf1ed34285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:41 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Volume volume-6b48f708-112e-48d4-911d-16141e549acd (6b48f708-112e-48d4-911d-16141e549acd): created successfully Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeeced4a-ae0e-48ab-a272-90cf1ed34285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (79a04c17-cbee-4fe6-bcb3-8a463fe4ee58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-29c43fa9-fe72-4ec8-8da5-0029e3773fd9 tempest-VolumesGetTest-1354708599 None] Created volume successfully. Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5021f150-1df3-4b1f-b2d9-0ce81d62c494 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6-detach_volume" by "detach_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5021f150-1df3-4b1f-b2d9-0ce81d62c494 tempest-VolumesActionsTest-1389135844 None] Lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5021f150-1df3-4b1f-b2d9-0ce81d62c494 tempest-VolumesActionsTest-1389135844 None] Volume detach called, but volume not attached. Sep 09 16:52:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5021f150-1df3-4b1f-b2d9-0ce81d62c494 tempest-VolumesActionsTest-1389135844 None] Lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6-detach_volume" released by "detach_volume" :: held 0.037s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "cinder-quobyte-5f27e163-3538-4534-be9a-701bdf4721a6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Lock "cinder-quobyte-5f27e163-3538-4534-be9a-701bdf4721a6" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ea792-2328-48f6-9c86-e9bacbffb17e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:42 devstack sudo[97426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6 Sep 09 16:52:42 devstack sudo[97426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:43 devstack sudo[97426]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6" returned: 0 in 0.861s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:43 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6 Sep 09 16:52:43 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:43 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5f27e163-3538-4534-be9a-701bdf4721a6" returned: 0 in 0.554s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Lock "cinder-quobyte-5f27e163-3538-4534-be9a-701bdf4721a6" released by "delete_volume" :: held 1.559s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:44 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Created reservations ['c41ebb47-1ffa-4778-846a-855bb087d722', '695c2a1e-60f1-4135-934e-ad3d53e016c2', '322e7f22-9c8a-49e7-a973-226c351871f7', 'cc97cb90-0001-4589-ab17-52c5ce2a4e33'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:52:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:44 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:52:44 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:45 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.616s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:52:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Deleted volume successfully. Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ab1306-18ac-48ee-af27-59d47634cb10 tempest-VolumesActionsTest-1389135844 None] Lock "cinder-5f27e163-3538-4534-be9a-701bdf4721a6-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:45 devstack sudo[97454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:52:45 devstack sudo[97454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (a5519bf9-d9e0-4d88-81d7-265f17a8e878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9bf048-34f3-46c8-8505-55ba7f9e62cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9bf048-34f3-46c8-8505-55ba7f9e62cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-855310781',display_name='tempest-VolumesGetTest-Volume-1933312107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af3c79e-803f-4758-92c8-a643e4144e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:45Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33b6531-1abc-44d6-bf00-0f6bd497a94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b33b6531-1abc-44d6-bf00-0f6bd497a94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f4aef5-1250-440c-a295-6fc0bc3d874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67f4aef5-1250-440c-a295-6fc0bc3d874c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af3c79e-803f-4758-92c8-a643e4144e40', 'volume_name': 'volume-9af3c79e-803f-4758-92c8-a643e4144e40', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c06b91-6dcf-4d49-9211-93e8dbfab1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c06b91-6dcf-4d49-9211-93e8dbfab1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e920052-3424-4222-81e0-b50fcc3a77db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Volume 9af3c79e-803f-4758-92c8-a643e4144e40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af3c79e-803f-4758-92c8-a643e4144e40', 'volume_size': 1} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-855310781',display_name='tempest-VolumesGetTest-Volume-1933312107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af3c79e-803f-4758-92c8-a643e4144e40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:45Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Creating volume 9af3c79e-803f-4758-92c8-a643e4144e40 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:52:45 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:45 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40 1073741824 Sep 09 16:52:45 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:45 devstack sudo[97454]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.469s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:52:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:52:46 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40 1073741824" returned: 0 in 0.843s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:46 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40 Sep 09 16:52:46 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:46 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] <== create_volume: return (1213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:52:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e920052-3424-4222-81e0-b50fcc3a77db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af3c79e-803f-4758-92c8-a643e4144e40', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f5e798-5583-4059-bafd-86e211403fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Volume volume-9af3c79e-803f-4758-92c8-a643e4144e40 (9af3c79e-803f-4758-92c8-a643e4144e40): created successfully Sep 09 16:52:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2f5e798-5583-4059-bafd-86e211403fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (a5519bf9-d9e0-4d88-81d7-265f17a8e878) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-723141d4-fa05-483e-bfc0-16b938f993d5 tempest-VolumesGetTest-1354708599 None] Created volume successfully. Sep 09 16:52:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-9af3c79e-803f-4758-92c8-a643e4144e40-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Lock "cinder-9af3c79e-803f-4758-92c8-a643e4144e40-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-quobyte-9af3c79e-803f-4758-92c8-a643e4144e40" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-9af3c79e-803f-4758-92c8-a643e4144e40" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bd29a5-7bc6-424e-96a3-d756977c1a91]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:47 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40 Sep 09 16:52:47 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:47 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40" returned: 0 in 0.553s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:47 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40 Sep 09 16:52:47 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:48 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9af3c79e-803f-4758-92c8-a643e4144e40" returned: 0 in 0.352s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-9af3c79e-803f-4758-92c8-a643e4144e40" released by "delete_volume" :: held 0.964s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Created reservations ['ef1854e6-d9d2-43c3-9a2b-7924704577da', '6168cf86-d5df-45f8-aad3-908606760dcd', '2d4fe1cc-29a2-442a-be72-0f5a65ddc1e6', 'f7bf36d4-c0a2-41e0-887d-c1e0a8749d95'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:48 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:52:48 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:48 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.450s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:48 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:52:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Deleted volume successfully. Sep 09 16:52:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6f4301a0-ac50-4d18-adf8-e51c2b235094 tempest-VolumesGetTest-1354708599 None] Lock "cinder-9af3c79e-803f-4758-92c8-a643e4144e40-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-6b48f708-112e-48d4-911d-16141e549acd-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Lock "cinder-6b48f708-112e-48d4-911d-16141e549acd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-quobyte-6b48f708-112e-48d4-911d-16141e549acd" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-6b48f708-112e-48d4-911d-16141e549acd" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1418fb-fe5d-4c5d-86ea-45216a7b0bba]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (c7b635ea-43f4-48c9-9258-055e3f54cbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:50 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd Sep 09 16:52:50 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54072f66-ddcc-4211-a3c7-4aa67f6bf6d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54072f66-ddcc-4211-a3c7-4aa67f6bf6d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1469263540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9322fe-e4de-43ce-8f5b-351c5ac78bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:50Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6002f3ae-ab1a-4c4e-a5ac-261dd63e7243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6002f3ae-ab1a-4c4e-a5ac-261dd63e7243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cd648c-56fd-4a08-bd94-ec0625459b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7cd648c-56fd-4a08-bd94-ec0625459b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd9322fe-e4de-43ce-8f5b-351c5ac78bb1', 'volume_name': 'volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15764927-9972-4acb-8592-5e59c4a961ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15764927-9972-4acb-8592-5e59c4a961ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b69a82-99aa-4e8d-ac6a-5f8019f286c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Volume dd9322fe-e4de-43ce-8f5b-351c5ac78bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1', 'volume_size': 1} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1469263540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd9322fe-e4de-43ce-8f5b-351c5ac78bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:50Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Creating volume dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:52:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:50 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 1073741824 Sep 09 16:52:50 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:50 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd" returned: 0 in 0.725s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:50 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd Sep 09 16:52:50 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:51 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 1073741824" returned: 0 in 0.849s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:51 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b48f708-112e-48d4-911d-16141e549acd" returned: 0 in 0.536s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-6b48f708-112e-48d4-911d-16141e549acd" released by "delete_volume" :: held 1.400s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:51 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 Sep 09 16:52:51 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Created reservations ['49934fc8-5fcc-4ec3-bb56-a52b15314176', 'e3eb1fa0-ee86-4b8f-a97e-d111aa4a6aa1', 'dad453f7-5ac9-4012-95d0-2201cb2b13ba', '2dfbe3c4-7578-4753-8a53-d12e748b22b7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:51 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:52:51 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:51 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1" returned: 0 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] <== create_volume: return (1355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.359s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26b69a82-99aa-4e8d-ac6a-5f8019f286c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802357d4-ce0e-422b-9496-38186061124f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Volume volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 (dd9322fe-e4de-43ce-8f5b-351c5ac78bb1): created successfully Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (802357d4-ce0e-422b-9496-38186061124f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (c7b635ea-43f4-48c9-9258-055e3f54cbd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3a5d418e-a2a4-49f8-8285-1e09e512f4d5 tempest-VolumesActionsTest-1389135844 None] Created volume successfully. Sep 09 16:52:51 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:51 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:52:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Deleted volume successfully. Sep 09 16:52:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-faff9c83-77dd-45db-b3b0-2eb1945e4c2d tempest-VolumesGetTest-1354708599 None] Lock "cinder-6b48f708-112e-48d4-911d-16141e549acd-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Acquiring lock "cinder-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Lock "cinder-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Acquiring lock "cinder-quobyte-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Lock "cinder-quobyte-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[541e4a97-05ce-4f79-bb08-b7c308c6696d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (d9e04597-e0ab-4215-8aea-2f9ae810edb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a98122-a91e-4d46-adfb-2bdace6bb619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a98122-a91e-4d46-adfb-2bdace6bb619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-714571394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6011b0ac-95c3-4832-b57b-5842281a56e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:53Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260a3d8f-fbbd-4ebf-91e1-b244fb9c6f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (260a3d8f-fbbd-4ebf-91e1-b244fb9c6f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d0f15d-4c91-4f1a-97a7-0648c8153b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81d0f15d-4c91-4f1a-97a7-0648c8153b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6011b0ac-95c3-4832-b57b-5842281a56e8', 'volume_name': 'volume-6011b0ac-95c3-4832-b57b-5842281a56e8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:53 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 Sep 09 16:52:53 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7572d2-cb2f-4cc3-b85d-7fb6026ba9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7572d2-cb2f-4cc3-b85d-7fb6026ba9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f49a1e0-0b7a-4cae-a420-3db23933fb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Volume 6011b0ac-95c3-4832-b57b-5842281a56e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6011b0ac-95c3-4832-b57b-5842281a56e8', 'volume_size': 1} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-714571394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6011b0ac-95c3-4832-b57b-5842281a56e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:53Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Creating volume 6011b0ac-95c3-4832-b57b-5842281a56e8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:52:53 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:52:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:53 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 1073741824 Sep 09 16:52:53 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:54 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1" returned: 0 in 0.712s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:54 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1 Sep 09 16:52:54 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:54 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 1073741824" returned: 0 in 0.844s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:54 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 Sep 09 16:52:54 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:54 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1" returned: 0 in 0.679s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Lock "cinder-quobyte-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1" released by "delete_volume" :: held 1.494s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Created reservations ['3c7af919-fbae-4b2a-be16-53f7ae22b073', '817e870e-a8c3-4424-be4c-6ef17fb2a3cc', 'f268dad2-5e5e-470f-9f49-fc4ab1d13d2d', 'ac55ede7-86fe-4ea4-9d81-e4a1e5f96ad1'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:55 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:52:55 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:55 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8" returned: 0 in 0.561s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:52:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:52:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f49a1e0-0b7a-4cae-a420-3db23933fb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6011b0ac-95c3-4832-b57b-5842281a56e8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acfe75e-c7bb-426a-876c-55fdb93b3670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Volume volume-6011b0ac-95c3-4832-b57b-5842281a56e8 (6011b0ac-95c3-4832-b57b-5842281a56e8): created successfully Sep 09 16:52:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acfe75e-c7bb-426a-876c-55fdb93b3670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (d9e04597-e0ab-4215-8aea-2f9ae810edb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-41ed74ec-c73b-4553-a813-f230d56da8d7 tempest-VolumesGetTest-1354708599 None] Created volume successfully. Sep 09 16:52:55 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.466s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:55 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:52:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Deleted volume successfully. Sep 09 16:52:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3e572b97-7832-4bc0-8dcf-c568c22da2d0 tempest-VolumesActionsTest-609580949 None] Lock "cinder-dd9322fe-e4de-43ce-8f5b-351c5ac78bb1-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:52:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (97c36154-e526-4b7f-917c-1bfb94fcc4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1c07f5-042d-49c8-aa8e-381384ecd8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1c07f5-042d-49c8-aa8e-381384ecd8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-653421520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a83454d0-b2aa-4f64-a1b9-53976246d6b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6011b0ac-95c3-4832-b57b-5842281a56e8,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:57Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad90ec03-5947-4201-ba61-33d28bc19d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad90ec03-5947-4201-ba61-33d28bc19d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fcf655f-c14a-44a4-adac-1d8f7ef07eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fcf655f-c14a-44a4-adac-1d8f7ef07eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a83454d0-b2aa-4f64-a1b9-53976246d6b3', 'volume_name': 'volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3', 'volume_size': 1, 'source_volid': '6011b0ac-95c3-4832-b57b-5842281a56e8', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dd7ddd-7c9e-44e0-bf14-98ccc6d340ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50dd7ddd-7c9e-44e0-bf14-98ccc6d340ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd111b3-97bb-47a1-b27d-e2e854921058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Volume a83454d0-b2aa-4f64-a1b9-53976246d6b3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3', 'volume_size': 1, 'source_volid': '6011b0ac-95c3-4832-b57b-5842281a56e8', 'source_volstatus': 'available'} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (c7e72f58-ec91-4146-93bd-2be93c75b575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce859e01-b204-4bc0-9ef1-cb4633c63fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:52:57 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Cloning volume 6011b0ac-95c3-4832-b57b-5842281a56e8 to volume a83454d0-b2aa-4f64-a1b9-53976246d6b3 Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce859e01-b204-4bc0-9ef1-cb4633c63fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-124098264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865adc1d-df86-45a1-9b87-3a6d70c86184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:57Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96f4dd-a992-43ca-8c5c-90a707713e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96f4dd-a992-43ca-8c5c-90a707713e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa61b5a-c67c-4105-8288-739dce441504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6aa61b5a-c67c-4105-8288-739dce441504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865adc1d-df86-45a1-9b87-3a6d70c86184', 'volume_name': 'volume-865adc1d-df86-45a1-9b87-3a6d70c86184', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558b65ef-1e95-4116-9669-76c2b2c27a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (558b65ef-1e95-4116-9669-76c2b2c27a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f297e2f-5c1b-46dd-a1c7-b3e0e45e210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:52:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Volume 865adc1d-df86-45a1-9b87-3a6d70c86184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865adc1d-df86-45a1-9b87-3a6d70c86184', 'volume_size': 1} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Creating offline snapshot 67f5b185-8d4a-46f8-a437-b662570c2288 of volume 6011b0ac-95c3-4832-b57b-5842281a56e8 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[659bac72-cdb6-47c3-81aa-48dc2df07783]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:52:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:57 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 Sep 09 16:52:57 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:58 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8" returned: 0 in 0.595s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:58 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 1G Sep 09 16:52:58 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:58 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 1G" returned: 0 in 0.610s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6011b0ac-95c3-4832-b57b-5842281a56e8 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:58 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6011b0ac-95c3-4832-b57b-5842281a56e8 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 Sep 09 16:52:58 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:59 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6011b0ac-95c3-4832-b57b-5842281a56e8 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:59 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 is being set with open permissions: ugo+rw Sep 09 16:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:59 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 Sep 09 16:52:59 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:59 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:59 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.info Sep 09 16:52:59 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:52:59 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Sep 09 16:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.info" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:52:59 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.info is being set with open permissions: ugo+rw Sep 09 16:52:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:52:59 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.info Sep 09 16:52:59 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:00 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.info" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-quobyte-a83454d0-b2aa-4f64-a1b9-53976246d6b3" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-a83454d0-b2aa-4f64-a1b9-53976246d6b3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] snapshot: 67f5b185-8d4a-46f8-a437-b662570c2288, volume: a83454d0-b2aa-4f64-a1b9-53976246d6b3, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5df67d-ce70-487f-8278-05d6db75db53]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:00 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 Sep 09 16:53:00 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:00 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288" returned: 0 in 0.500s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6011b0ac-95c3-4832-b57b-5842281a56e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9224d9c4-1bc9-4caf-a704-16540801f553]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:00 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 Sep 09 16:53:00 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:01 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 16:53:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 16:53:01 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 16:53:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:01 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 Sep 09 16:53:01 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:07 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3" returned: 0 in 6.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:07 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8, size 1024.00 MB, duration 6.38 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:53:07 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Converted 1024.00 MB image at 160.42 MB/s Sep 09 16:53:07 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 is being set with open permissions: ugo+rw Sep 09 16:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:07 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 Sep 09 16:53:07 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:07 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3" returned: 0 in 0.480s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-a83454d0-b2aa-4f64-a1b9-53976246d6b3" released by "_copy_volume_from_snapshot" :: held 7.895s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-quobyte-67f5b185-8d4a-46f8-a437-b662570c2288" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-67f5b185-8d4a-46f8-a437-b662570c2288" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Deleting offline snapshot 67f5b185-8d4a-46f8-a437-b662570c2288 of volume 6011b0ac-95c3-4832-b57b-5842281a56e8 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:53:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] snapshot_file for this snap is: volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:53:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e46caad-9401-464f-8656-5c5b7dae9b6f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:08 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 Sep 09 16:53:08 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:08 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288" returned: 0 in 0.611s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6011b0ac-95c3-4832-b57b-5842281a56e8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:53:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c2565e-377b-486d-9847-f33b71c3360e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:08 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 Sep 09 16:53:08 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:09 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8" returned: 0 in 0.651s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:09 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 Sep 09 16:53:09 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:09 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=38,cinder:UPDATE=53,cinder:INSERT=13,cinder:DELETE=7 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:53:09 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288" returned: 0 in 0.375s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:09 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288 Sep 09 16:53:09 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:10 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8.67f5b185-8d4a-46f8-a437-b662570c2288" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-67f5b185-8d4a-46f8-a437-b662570c2288" released by "_delete_snapshot" :: held 2.069s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.820s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.763s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:52:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-124098264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865adc1d-df86-45a1-9b87-3a6d70c86184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:52:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:52:57Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Creating volume 865adc1d-df86-45a1-9b87-3a6d70c86184 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:10 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd111b3-97bb-47a1-b27d-e2e854921058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3', 'volume_size': 1, 'source_volid': '6011b0ac-95c3-4832-b57b-5842281a56e8', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f341887-d031-45e2-af96-a73c20ebd476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:10 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184 1073741824 Sep 09 16:53:10 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Volume volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 (a83454d0-b2aa-4f64-a1b9-53976246d6b3): created successfully Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f341887-d031-45e2-af96-a73c20ebd476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (97c36154-e526-4b7f-917c-1bfb94fcc4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2fbaaef1-7080-4ce5-a435-14fd0bd17123 tempest-VolumesGetTest-1354708599 None] Created volume successfully. Sep 09 16:53:10 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184 1073741824" returned: 0 in 0.559s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:10 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184 Sep 09 16:53:10 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:11 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f297e2f-5c1b-46dd-a1c7-b3e0e45e210d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865adc1d-df86-45a1-9b87-3a6d70c86184', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a5761a-9c92-488a-b00f-b38fc792dd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Volume volume-865adc1d-df86-45a1-9b87-3a6d70c86184 (865adc1d-df86-45a1-9b87-3a6d70c86184): created successfully Sep 09 16:53:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a5761a-9c92-488a-b00f-b38fc792dd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (c7e72f58-ec91-4146-93bd-2be93c75b575) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-81a35abe-1a51-46fe-bd68-f1703c6fa180 tempest-VolumesActionsTest-1389135844 None] Created volume successfully. Sep 09 16:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Acquiring lock "cinder-865adc1d-df86-45a1-9b87-3a6d70c86184-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Lock "cinder-865adc1d-df86-45a1-9b87-3a6d70c86184-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Acquiring lock "cinder-quobyte-865adc1d-df86-45a1-9b87-3a6d70c86184" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Lock "cinder-quobyte-865adc1d-df86-45a1-9b87-3a6d70c86184" acquired by "delete_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a4361d-53ef-4408-b510-40bf68b717db]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:12 devstack sudo[97818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184 Sep 09 16:53:12 devstack sudo[97818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (c77c62ad-bbad-495f-be5a-55ab7ee81edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6783f4e-5d01-439d-9ea7-9e21d7974ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6783f4e-5d01-439d-9ea7-9e21d7974ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2094793623',display_name='tempest-VolumesGetTest-Volume-1350958589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6001214b-2957-4368-98a9-4c0aeb2c1a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:13Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11efc312-b7eb-4137-8830-d3bc023eb42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11efc312-b7eb-4137-8830-d3bc023eb42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7fe998-ebf4-448e-b40b-18a36e2e89ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7fe998-ebf4-448e-b40b-18a36e2e89ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6001214b-2957-4368-98a9-4c0aeb2c1a62', 'volume_name': 'volume-6001214b-2957-4368-98a9-4c0aeb2c1a62', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8beb1de3-df43-4590-9b37-fbf40b3a34d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8beb1de3-df43-4590-9b37-fbf40b3a34d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:13 devstack sudo[97818]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707c0c73-eb93-41d6-8427-682e91c27626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Volume 6001214b-2957-4368-98a9-4c0aeb2c1a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6001214b-2957-4368-98a9-4c0aeb2c1a62', 'volume_size': 1} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2094793623',display_name='tempest-VolumesGetTest-Volume-1350958589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6001214b-2957-4368-98a9-4c0aeb2c1a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:13Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Creating volume 6001214b-2957-4368-98a9-4c0aeb2c1a62 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184" returned: 0 in 0.993s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:13 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62 1073741824 Sep 09 16:53:13 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:13 devstack sudo[97833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184 Sep 09 16:53:13 devstack sudo[97833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:13 devstack sudo[97833]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-865adc1d-df86-45a1-9b87-3a6d70c86184" returned: 0 in 0.420s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Lock "cinder-quobyte-865adc1d-df86-45a1-9b87-3a6d70c86184" released by "delete_volume" :: held 1.516s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Created reservations ['852026e0-8680-4be4-ae18-afbf86dcddf8', '5d62812a-1b6f-4b90-bff7-ef5beef564d2', 'ac9ca601-4196-410a-951f-cdc0ba572a55', '5c1f9ad5-d6f4-4153-8663-c8b84ae6f0a3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:14 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:14 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:14 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62 1073741824" returned: 0 in 1.098s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:14 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62 Sep 09 16:53:14 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:14 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.468s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Deleted volume successfully. Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d68841f4-ebed-43c2-af8b-50b830ed819d tempest-VolumesActionsTest-609580949 None] Lock "cinder-865adc1d-df86-45a1-9b87-3a6d70c86184-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:14 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62" returned: 0 in 0.616s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] <== create_volume: return (1841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (707c0c73-eb93-41d6-8427-682e91c27626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6001214b-2957-4368-98a9-4c0aeb2c1a62', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff308477-792c-42af-b781-8165fb170d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Volume volume-6001214b-2957-4368-98a9-4c0aeb2c1a62 (6001214b-2957-4368-98a9-4c0aeb2c1a62): created successfully Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff308477-792c-42af-b781-8165fb170d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (c77c62ad-bbad-495f-be5a-55ab7ee81edd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-470a76f4-1dc9-478c-a747-fb1f069d10a9 tempest-VolumesGetTest-1354708599 None] Created volume successfully. Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (10b18fb9-f72e-434c-8754-47cc334b2b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679824f7-a5bd-430d-bfff-4022c0c8667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679824f7-a5bd-430d-bfff-4022c0c8667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1981686274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:16Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec445bb-fc76-4d69-9806-8d07350aa6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ec445bb-fc76-4d69-9806-8d07350aa6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e76e79-3d24-428d-8111-c568145ab783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e76e79-3d24-428d-8111-c568145ab783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0', 'volume_name': 'volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a644989b-83df-4f92-b52c-b412d4d6c4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a644989b-83df-4f92-b52c-b412d4d6c4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b243cb4-c58c-4645-b01d-9f43fd0c0e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Volume 00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0', 'volume_size': 1} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1981686274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:16Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Creating volume 00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:15 devstack sudo[97864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 1073741824 Sep 09 16:53:15 devstack sudo[97864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-6001214b-2957-4368-98a9-4c0aeb2c1a62-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Lock "cinder-6001214b-2957-4368-98a9-4c0aeb2c1a62-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:16 devstack sudo[97864]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 1073741824" returned: 0 in 0.544s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-quobyte-6001214b-2957-4368-98a9-4c0aeb2c1a62" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-6001214b-2957-4368-98a9-4c0aeb2c1a62" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:16 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 Sep 09 16:53:16 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[300fac0b-1179-453e-8615-90e3e6f6cc7d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:16 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62 Sep 09 16:53:16 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:16 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b243cb4-c58c-4645-b01d-9f43fd0c0e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98673027-f86c-4e22-a293-837683fa134d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Volume volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 (00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0): created successfully Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98673027-f86c-4e22-a293-837683fa134d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (10b18fb9-f72e-434c-8754-47cc334b2b58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-df80d224-82c6-4bc8-8936-9dcea3892a37 tempest-VolumesActionsTest-1389135844 None] Created volume successfully. Sep 09 16:53:17 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62" returned: 0 in 0.607s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:17 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62 Sep 09 16:53:17 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:17 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6001214b-2957-4368-98a9-4c0aeb2c1a62" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-6001214b-2957-4368-98a9-4c0aeb2c1a62" released by "delete_volume" :: held 0.993s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Created reservations ['6266ad6f-cef9-46a3-a227-1de5f3b8d6f4', '58e37796-a22c-4876-b84b-936132bf763f', '17d8b410-de45-4f54-b56c-2fb67d6e99cb', 'f821c3e9-47e2-4e69-a95f-fa0336bafc7d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:17 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:17 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:18 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:18 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Deleted volume successfully. Sep 09 16:53:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-69811ea6-c05c-4088-b6c8-b1f41baa935d tempest-VolumesGetTest-1354708599 None] Lock "cinder-6001214b-2957-4368-98a9-4c0aeb2c1a62-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Acquiring lock "cinder-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Lock "cinder-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Acquiring lock "cinder-quobyte-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Lock "cinder-quobyte-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0" acquired by "delete_volume" :: waited 0.049s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d08d28-c7d1-4e10-93e4-2e785e6fc64e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:18 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 Sep 09 16:53:18 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-a83454d0-b2aa-4f64-a1b9-53976246d6b3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Lock "cinder-a83454d0-b2aa-4f64-a1b9-53976246d6b3-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-quobyte-a83454d0-b2aa-4f64-a1b9-53976246d6b3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-a83454d0-b2aa-4f64-a1b9-53976246d6b3" acquired by "delete_volume" :: waited 0.052s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:19 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42a8456-f7be-4463-bc3c-bb4409495aaa]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:19 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0" returned: 0 in 0.899s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:19 devstack sudo[97932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0 Sep 09 16:53:19 devstack sudo[97932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:19 devstack sudo[97931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 Sep 09 16:53:19 devstack sudo[97931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:19 devstack sudo[97932]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0" returned: 0 in 0.546s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Lock "cinder-quobyte-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0" released by "delete_volume" :: held 1.577s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Created reservations ['cc807be5-c2d2-4bd7-b143-a3c5fb399020', 'c654b9b0-ce83-49a0-b1f8-01bf1d4b511d', 'b149c037-151f-4e87-a0bc-708f17a5a00f', '992939df-9a7e-4ddc-b8ab-9148db594e79'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:20 devstack sudo[97931]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Flow 'volume_create_manager' (6fd03254-640f-4179-94d1-c1b97b9aaf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e172a34-e5ca-43d9-8867-4896e1fc7ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3" returned: 0 in 1.174s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:20 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:20 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:20 devstack sudo[97941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3 Sep 09 16:53:20 devstack sudo[97941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e172a34-e5ca-43d9-8867-4896e1fc7ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-297060727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc48979dfa747098df5d387cd8bf336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:20Z,use_quota=True,user_id='0d3a301f2b2345e5af689aa76bb10838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af878f5-05d1-416e-889c-299cca2a98de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af878f5-05d1-416e-889c-299cca2a98de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6652096-83f6-4325-8dd9-4b6ea101ad05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6652096-83f6-4325-8dd9-4b6ea101ad05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b', 'volume_name': 'volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5582fd22-b275-443a-87a4-1d9215bbf2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5582fd22-b275-443a-87a4-1d9215bbf2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cec9443-af43-4d28-b941-93d454756c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Volume 40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b', 'volume_size': 1} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-297060727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bc48979dfa747098df5d387cd8bf336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:20Z,use_quota=True,user_id='0d3a301f2b2345e5af689aa76bb10838',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Creating volume 40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:20 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b 1073741824 Sep 09 16:53:20 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:21 devstack sudo[97941]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a83454d0-b2aa-4f64-a1b9-53976246d6b3" returned: 0 in 1.151s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-a83454d0-b2aa-4f64-a1b9-53976246d6b3" released by "delete_volume" :: held 2.434s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:21 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 1.324s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Deleted volume successfully. Sep 09 16:53:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-66901507-42f7-4f4e-bd60-e0634d307968 tempest-VolumesActionsTest-609580949 None] Lock "cinder-00909fbe-5b31-48aa-8f9a-b09ba9b4b2e0-delete_volume" released by "delete_volume" :: held 3.624s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Created reservations ['57110665-5300-4ebf-ac98-4e79f7970a84', '088cf443-332f-410b-86d8-dbf58745e94e', 'f75f1dd4-99f1-4212-9114-49130ceb7d2c', '646130ff-1a2b-4f3f-98be-662d9f498617'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:22 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b 1073741824" returned: 0 in 1.377s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:22 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:22 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:22 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b Sep 09 16:53:22 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:22 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.620s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Deleted volume successfully. Sep 09 16:53:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0cfbd6d9-5622-4c24-9156-6bda5b99d9b5 tempest-VolumesGetTest-1354708599 None] Lock "cinder-a83454d0-b2aa-4f64-a1b9-53976246d6b3-delete_volume" released by "delete_volume" :: held 3.853s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (3716435a-3757-4f6c-ac99-51e2ae832b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3926adb-74fe-413e-a680-003ab38a9947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3926adb-74fe-413e-a680-003ab38a9947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1826873105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bfaa71-edae-4be0-903a-0618f8ceeaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:23Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b1c4e8-28a2-405d-a048-c93ab1d408b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20b1c4e8-28a2-405d-a048-c93ab1d408b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c178ab67-c85a-415d-964e-c2e81b632594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:23 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c178ab67-c85a-415d-964e-c2e81b632594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0bfaa71-edae-4be0-903a-0618f8ceeaea', 'volume_name': 'volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1ceb84-1a2d-4597-af02-cfc5def0c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e1ceb84-1a2d-4597-af02-cfc5def0c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c488c4-1cbb-47f6-8992-05ed23200a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Volume c0bfaa71-edae-4be0-903a-0618f8ceeaea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea', 'volume_size': 1} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b" returned: 0 in 0.979s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] <== create_volume: return (2483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.500s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1826873105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bfaa71-edae-4be0-903a-0618f8ceeaea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:23Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Creating volume c0bfaa71-edae-4be0-903a-0618f8ceeaea {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:23 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-6011b0ac-95c3-4832-b57b-5842281a56e8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:23 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea 1073741824 Sep 09 16:53:23 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cec9443-af43-4d28-b941-93d454756c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af39b51f-9bb1-4ffe-ae14-34b39323db97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Lock "cinder-6011b0ac-95c3-4832-b57b-5842281a56e8-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Volume volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b (40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b): created successfully Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af39b51f-9bb1-4ffe-ae14-34b39323db97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Flow 'volume_create_manager' (6fd03254-640f-4179-94d1-c1b97b9aaf2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3e2e4988-44ca-497f-9728-3a13e9e70170 tempest-AttachVolumeNegativeTest-1647988275 None] Created volume successfully. Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-quobyte-6011b0ac-95c3-4832-b57b-5842281a56e8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-6011b0ac-95c3-4832-b57b-5842281a56e8" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c2d82a-9bdb-4798-bcb3-8bf83defa34b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:23 devstack sudo[98023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 Sep 09 16:53:23 devstack sudo[98023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:24 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea 1073741824" returned: 0 in 0.879s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:24 devstack sudo[98023]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8" returned: 0 in 0.660s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:24 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8 Sep 09 16:53:24 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:24 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea Sep 09 16:53:24 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:24 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6011b0ac-95c3-4832-b57b-5842281a56e8" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:24 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-6011b0ac-95c3-4832-b57b-5842281a56e8" released by "delete_volume" :: held 1.188s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea" returned: 0 in 0.425s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c488c4-1cbb-47f6-8992-05ed23200a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0c1ecc-4495-4810-afe8-f69ff84121ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Volume volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea (c0bfaa71-edae-4be0-903a-0618f8ceeaea): created successfully Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f0c1ecc-4495-4810-afe8-f69ff84121ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (3716435a-3757-4f6c-ac99-51e2ae832b55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-55a8a2f5-d958-4b69-bbbf-0829e8eb16eb tempest-VolumesActionsTest-1389135844 None] Created volume successfully. Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Created reservations ['5eac597f-2517-4928-b444-9f0ad7af32d5', '4563bd2b-2405-4f38-b7fb-bccbf2a87cb9', 'e529e28f-d243-4613-9f31-07b1eb9e49d4', 'd19fd3a0-a707-44cf-a92d-ecae01eb644d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:24 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:25 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0146eb66-f2a3-4efb-81c3-6c5739e2bc22 req-e4852932-31d6-4d70-855a-5b163fad1aa0 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0146eb66-f2a3-4efb-81c3-6c5739e2bc22 req-e4852932-31d6-4d70-855a-5b163fad1aa0 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0146eb66-f2a3-4efb-81c3-6c5739e2bc22 req-e4852932-31d6-4d70-855a-5b163fad1aa0 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-0146eb66-f2a3-4efb-81c3-6c5739e2bc22 req-e4852932-31d6-4d70-855a-5b163fad1aa0 tempest-AttachVolumeNegativeTest-1647988275 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6e1413f-f596-4acb-b370-d82b0c4456da', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Acquiring lock "cinder-c0bfaa71-edae-4be0-903a-0618f8ceeaea-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:25 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Deleted volume successfully. Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Lock "cinder-c0bfaa71-edae-4be0-903a-0618f8ceeaea-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-0146eb66-f2a3-4efb-81c3-6c5739e2bc22 req-e4852932-31d6-4d70-855a-5b163fad1aa0 tempest-AttachVolumeNegativeTest-1647988275 None] attachment_update completed successfully. Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dcb9a2c5-1954-4f18-a4b7-bfd1224cb29e tempest-VolumesGetTest-1354708599 None] Lock "cinder-6011b0ac-95c3-4832-b57b-5842281a56e8-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Acquiring lock "cinder-quobyte-c0bfaa71-edae-4be0-903a-0618f8ceeaea" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Lock "cinder-quobyte-c0bfaa71-edae-4be0-903a-0618f8ceeaea" acquired by "delete_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[feca0c43-b72f-4eb0-a6a1-82a35016e13e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:25 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea Sep 09 16:53:25 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:26 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea" returned: 0 in 0.521s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:26 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea Sep 09 16:53:26 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:26 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c0bfaa71-edae-4be0-903a-0618f8ceeaea" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Lock "cinder-quobyte-c0bfaa71-edae-4be0-903a-0618f8ceeaea" released by "delete_volume" :: held 0.907s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Created reservations ['bc9c6b42-95f1-499d-b59c-a08ae5eca134', '76e8dcdc-d2c1-4713-8587-a7293c1fd81c', '40bdcf67-45a1-47c2-b3cc-1431fd585314', '0c1a1664-ef7d-4f6d-b782-bf4940fc1a34'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:26 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:26 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (7947e461-f579-4379-849b-0916ef5b60cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf0db16-549f-4c7c-bba2-6d18bf8e85a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf0db16-549f-4c7c-bba2-6d18bf8e85a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-914859785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c02a6b-8014-4266-93b5-0fe8f112808f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:27Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476d15cb-77b9-42f5-9534-3ffa2e01141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (476d15cb-77b9-42f5-9534-3ffa2e01141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b8d39d-9fac-4b0b-8f81-fd3e295c95d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 16:53:26 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Deleted volume successfully. Sep 09 16:53:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4a964551-b37c-4758-bcb9-d6924fc074a5 tempest-VolumesActionsTest-609580949 None] Lock "cinder-c0bfaa71-edae-4be0-903a-0618f8ceeaea-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b8d39d-9fac-4b0b-8f81-fd3e295c95d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2c02a6b-8014-4266-93b5-0fe8f112808f', 'volume_name': 'volume-c2c02a6b-8014-4266-93b5-0fe8f112808f', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af87d83f-bbe2-4055-bf87-b10fb7b932b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af87d83f-bbe2-4055-bf87-b10fb7b932b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3408d5-bb2b-48e7-9c65-7996e3e23d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Volume c2c02a6b-8014-4266-93b5-0fe8f112808f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2c02a6b-8014-4266-93b5-0fe8f112808f', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Trying to clone c2c02a6b-8014-4266-93b5-0fe8f112808f from image c8a55b28-da06-4b7e-8774-d16bdd532dbb at location (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (404ce6e5-4376-4eeb-bc93-f60f4ccbddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58271cf-522b-4f2c-8e45-85c817c52e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58271cf-522b-4f2c-8e45-85c817c52e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1070445298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5183db6-a27a-4dea-8747-92bf02992d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:27Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d51e55e-cd36-48e2-b58c-ab65b8c8f380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d51e55e-cd36-48e2-b58c-ab65b8c8f380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3364edd-e4d9-4b4c-8108-15c52a507c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3364edd-e4d9-4b4c-8108-15c52a507c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5183db6-a27a-4dea-8747-92bf02992d2e', 'volume_name': 'volume-f5183db6-a27a-4dea-8747-92bf02992d2e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef095664-4e77-4760-96e0-5f5da5d590c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef095664-4e77-4760-96e0-5f5da5d590c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f72e82-7d6f-4505-bce8-cfee54fcea72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Volume f5183db6-a27a-4dea-8747-92bf02992d2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5183db6-a27a-4dea-8747-92bf02992d2e', 'volume_size': 1} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1070445298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5183db6-a27a-4dea-8747-92bf02992d2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a96bb51cd024eb98355c3048bda35bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:27Z,use_quota=True,user_id='47d0d0d9244a4e889f19b971b199a69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Creating volume f5183db6-a27a-4dea-8747-92bf02992d2e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:27 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:27 devstack sudo[98468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e 1073741824 Sep 09 16:53:27 devstack sudo[98468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 16:53:27 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Image download 20.69 MB at 20.69 MB/s Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f56b301-1033-4f27-8222-b13dbdf84493]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:27 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD Sep 09 16:53:27 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:28 devstack sudo[98468]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e 1073741824" returned: 0 in 0.622s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:28 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e Sep 09 16:53:28 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-bbeb36b7-d7a3-4bd1-8fc8-4f7073d112c3 req-caeda4d8-35f8-4457-b2c6-e84936f75907 tempest-AttachVolumeNegativeTest-1647988275 None] Terminate volume connection completed successfully. Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-bbeb36b7-d7a3-4bd1-8fc8-4f7073d112c3 req-caeda4d8-35f8-4457-b2c6-e84936f75907 tempest-AttachVolumeNegativeTest-1647988275 None] Deleting attachment e6e1413f-f596-4acb-b370-d82b0c4456da. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:53:28 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD" returned: 0 in 0.497s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Temporary image c8a55b28-da06-4b7e-8774-d16bdd532dbb is fetched for user 7f384c267e754a09907cc11a6e5c0660. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5830785-8a73-4610-8f50-09460e86b4aa]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:28 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e" returned: 0 in 0.391s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19f72e82-7d6f-4505-bce8-cfee54fcea72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5183db6-a27a-4dea-8747-92bf02992d2e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661defb7-2eb7-41dc-91c2-81ba58598313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Flow 'volume_create_manager' (4c045858-f886-49f7-bf0b-0cb390a94ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:28 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD Sep 09 16:53:28 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd18cde2-39ed-44c0-b180-1e71750e7cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Volume volume-f5183db6-a27a-4dea-8747-92bf02992d2e (f5183db6-a27a-4dea-8747-92bf02992d2e): created successfully Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661defb7-2eb7-41dc-91c2-81ba58598313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Flow 'volume_create_manager' (404ce6e5-4376-4eeb-bc93-f60f4ccbddc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd18cde2-39ed-44c0-b180-1e71750e7cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1067856143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef92c3db-bd21-4a2d-b92e-0e451fbf0944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64870df86ae44eba84b7c2046355e1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:28Z,use_quota=True,user_id='6401cec895534711ba82ee67a65b3a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c75f3c-561c-4069-8de4-06f2d0cd8189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5c75f3c-561c-4069-8de4-06f2d0cd8189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94004fc-eded-4676-bbeb-3ea959f552a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94004fc-eded-4676-bbeb-3ea959f552a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef92c3db-bd21-4a2d-b92e-0e451fbf0944', 'volume_name': 'volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42be057d-611c-4322-b83d-0c13e5d41cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42be057d-611c-4322-b83d-0c13e5d41cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6247b47-340d-4e41-a751-36f55730ce2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Volume ef92c3db-bd21-4a2d-b92e-0e451fbf0944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944', 'volume_size': 1} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1067856143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef92c3db-bd21-4a2d-b92e-0e451fbf0944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64870df86ae44eba84b7c2046355e1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:28Z,use_quota=True,user_id='6401cec895534711ba82ee67a65b3a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Creating volume ef92c3db-bd21-4a2d-b92e-0e451fbf0944 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:28 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7dd674c7-fc09-441b-9daf-c11175dfbe33 tempest-VolumesActionsTest-1389135844 None] Created volume successfully. Sep 09 16:53:28 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944 1073741824 Sep 09 16:53:28 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:28 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:29 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944 1073741824" returned: 0 in 0.437s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:29 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944 Sep 09 16:53:29 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944" returned: 0 in 0.427s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] <== create_volume: return (920ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-914859785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2c02a6b-8014-4266-93b5-0fe8f112808f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:27Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Creating volume c2c02a6b-8014-4266-93b5-0fe8f112808f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:29 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:29 devstack sudo[98534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f 1073741824 Sep 09 16:53:29 devstack sudo[98534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6247b47-340d-4e41-a751-36f55730ce2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2cd856-2927-4723-b9b1-6b49a1183df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Volume volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944 (ef92c3db-bd21-4a2d-b92e-0e451fbf0944): created successfully Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc2cd856-2927-4723-b9b1-6b49a1183df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Flow 'volume_create_manager' (4c045858-f886-49f7-bf0b-0cb390a94ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-99cf3029-696b-4d6d-a1ff-661dd2440bab tempest-ServersNegativeTestJSON-693967386 None] Created volume successfully. Sep 09 16:53:30 devstack sudo[98534]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f 1073741824" returned: 0 in 0.769s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:30 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f Sep 09 16:53:30 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Acquiring lock "cinder-f5183db6-a27a-4dea-8747-92bf02992d2e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Lock "cinder-f5183db6-a27a-4dea-8747-92bf02992d2e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Acquiring lock "cinder-quobyte-f5183db6-a27a-4dea-8747-92bf02992d2e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:31 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f" returned: 0 in 0.633s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Lock "cinder-quobyte-f5183db6-a27a-4dea-8747-92bf02992d2e" acquired by "delete_volume" :: waited 0.046s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f634e1-d2e1-4ad5-bd3e-229b5accc0fa]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Attempting download of c8a55b28-da06-4b7e-8774-d16bdd532dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}])) to volume c2c02a6b-8014-4266-93b5-0fe8f112808f. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1197}} Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d45103-c366-4de1-950b-f718cf575ac0]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_zywyqu_x {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:31 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e Sep 09 16:53:31 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:31 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_zywyqu_x Sep 09 16:53:31 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:31 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_zywyqu_x" returned: 0 in 0.598s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_zywyqu_x {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:31 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e" returned: 0 in 0.714s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:31 devstack sudo[98566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e Sep 09 16:53:31 devstack sudo[98566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:31 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_zywyqu_x Sep 09 16:53:31 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:32 devstack sudo[98566]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f5183db6-a27a-4dea-8747-92bf02992d2e" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Lock "cinder-quobyte-f5183db6-a27a-4dea-8747-92bf02992d2e" released by "delete_volume" :: held 1.166s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:32 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_zywyqu_x" returned: 1 in 0.485s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_zywyqu_x' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba259283-1cb4-4a20-a97a-045fd149b278]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Created reservations ['83135522-b328-4163-8471-837b6d03ac15', '2b654088-f0a5-4968-b362-501173651525', '03861010-96e6-4e44-8548-5352ac0c9a95', '3e726291-a408-405c-ba80-f16e500d9b1b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:32 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD Sep 09 16:53:32 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:32 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:32 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:32 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] c8a55b28-da06-4b7e-8774-d16bdd532dbb was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:32 devstack sudo[98580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f Sep 09 16:53:32 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:32 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Deleted volume successfully. Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-67d30007-8cac-4db3-8be6-198663baa7be tempest-VolumesActionsTest-1389135844 None] Lock "cinder-f5183db6-a27a-4dea-8747-92bf02992d2e-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Flow 'volume_create_manager' (9d57e6bc-8547-4128-a8a9-144f5fdd2f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ac6578-c62b-43d0-bb02-8ccffa4d986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ac6578-c62b-43d0-bb02-8ccffa4d986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2122185297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7b1672-61e8-404a-b29e-820a443d8ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64870df86ae44eba84b7c2046355e1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:33Z,use_quota=True,user_id='6401cec895534711ba82ee67a65b3a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f452e14a-d978-49ae-a849-b22a5ce0e9ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f452e14a-d978-49ae-a849-b22a5ce0e9ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6d65ca-16b0-419b-bc74-f6e7a6aea2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a6d65ca-16b0-419b-bc74-f6e7a6aea2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b7b1672-61e8-404a-b29e-820a443d8ad6', 'volume_name': 'volume-6b7b1672-61e8-404a-b29e-820a443d8ad6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d807dd-4c5d-4c0b-8b7b-4d5e50471a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d807dd-4c5d-4c0b-8b7b-4d5e50471a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecbd63b-599f-490b-8d31-7951d64ad773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Volume 6b7b1672-61e8-404a-b29e-820a443d8ad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b7b1672-61e8-404a-b29e-820a443d8ad6', 'volume_size': 1} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2122185297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b7b1672-61e8-404a-b29e-820a443d8ad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64870df86ae44eba84b7c2046355e1c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:33Z,use_quota=True,user_id='6401cec895534711ba82ee67a65b3a63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Creating volume 6b7b1672-61e8-404a-b29e-820a443d8ad6 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:32 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:33 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6 1073741824 Sep 09 16:53:33 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:33 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6 1073741824" returned: 0 in 0.497s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:33 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=143,cinder:SELECT=114,cinder:INSERT=30,cinder:DELETE=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:53:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:33 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6 Sep 09 16:53:33 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:33 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ecbd63b-599f-490b-8d31-7951d64ad773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b7b1672-61e8-404a-b29e-820a443d8ad6', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b978859-60c0-4362-a519-00ed11268312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:33 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Volume volume-6b7b1672-61e8-404a-b29e-820a443d8ad6 (6b7b1672-61e8-404a-b29e-820a443d8ad6): created successfully Sep 09 16:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b978859-60c0-4362-a519-00ed11268312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Flow 'volume_create_manager' (9d57e6bc-8547-4128-a8a9-144f5fdd2f9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c2e690cc-e782-48ff-8f4a-f84794186b6a tempest-ServersNegativeTestJSON-693967386 None] Created volume successfully. Sep 09 16:53:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "cinder-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "cinder-quobyte-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-quobyte-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d721a75-753b-48f3-b8c7-6a52b0f4440c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:34 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b Sep 09 16:53:34 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:35 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f" returned: 0 in 2.332s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_2p3b_remdevstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:53:35 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Converted 112.00 MB image at 48.01 MB/s Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:35 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f 1G Sep 09 16:53:35 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:35 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b" returned: 0 in 0.501s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:35 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b Sep 09 16:53:35 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Acquiring lock "cinder-6b7b1672-61e8-404a-b29e-820a443d8ad6-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:35 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f 1G" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Downloaded image c8a55b28-da06-4b7e-8774-d16bdd532dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}])) to volume c2c02a6b-8014-4266-93b5-0fe8f112808f successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1242}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Temporary image c8a55b28-da06-4b7e-8774-d16bdd532dbb for user 7f384c267e754a09907cc11a6e5c0660 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Marking volume c2c02a6b-8014-4266-93b5-0fe8f112808f as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1146}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Lock "cinder-6b7b1672-61e8-404a-b29e-820a443d8ad6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Copying metadata from image c8a55b28-da06-4b7e-8774-d16bdd532dbb to c2c02a6b-8014-4266-93b5-0fe8f112808f. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Creating volume glance metadata for volume c2c02a6b-8014-4266-93b5-0fe8f112808f backed by image c8a55b28-da06-4b7e-8774-d16bdd532dbb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Acquiring lock "cinder-quobyte-6b7b1672-61e8-404a-b29e-820a443d8ad6" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Lock "cinder-quobyte-6b7b1672-61e8-404a-b29e-820a443d8ad6" acquired by "delete_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[414c9210-108a-4b5f-9e96-8bf2556e8ceb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:35 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-quobyte-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b" released by "delete_volume" :: held 0.925s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de3408d5-bb2b-48e7-9c65-7996e3e23d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2c02a6b-8014-4266-93b5-0fe8f112808f', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc184c64-2841-4b10-836e-7747ea197f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Volume volume-c2c02a6b-8014-4266-93b5-0fe8f112808f (c2c02a6b-8014-4266-93b5-0fe8f112808f): created successfully Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc184c64-2841-4b10-836e-7747ea197f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (7947e461-f579-4379-849b-0916ef5b60cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-36063c10-7a84-472e-aedd-85631e62094f tempest-VolumesGetTest-1354708599 None] Created volume successfully. Sep 09 16:53:35 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6 Sep 09 16:53:35 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Created reservations ['26c2c64b-d976-483d-a046-f327ee0829fb', 'cecee4a9-b93c-4fc5-863f-68ab7ed5ffa2', '365dffc0-4a82-4841-9690-59a356f40ea2', '7ba3dd17-1a6a-4cbc-ab51-c76a96446e9d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:35 devstack sudo[98616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:35 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:36 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:36 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6 Sep 09 16:53:36 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:36 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Deleted volume successfully. Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1d38d61-9cdf-4ed5-b360-329ef1f86806 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-40aaba5a-ef28-41d9-9585-a6bd8b1a9a4b-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:36 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6b7b1672-61e8-404a-b29e-820a443d8ad6" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Lock "cinder-quobyte-6b7b1672-61e8-404a-b29e-820a443d8ad6" released by "delete_volume" :: held 0.754s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Created reservations ['213f4639-fb27-4303-b40e-3dc73e001978', '35a48e82-aa71-4b9d-b144-a951a8aee510', '7ddb10e8-308c-4be3-86cb-de51d9a516e5', '7c927ba7-5485-4288-970a-06a970d15b77'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:36 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:36 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Acquiring lock "cinder-ef92c3db-bd21-4a2d-b92e-0e451fbf0944-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Lock "cinder-ef92c3db-bd21-4a2d-b92e-0e451fbf0944-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Acquiring lock "cinder-quobyte-ef92c3db-bd21-4a2d-b92e-0e451fbf0944" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Lock "cinder-quobyte-ef92c3db-bd21-4a2d-b92e-0e451fbf0944" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:36 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Deleted volume successfully. Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1fa541-d52f-440f-9649-4041360a7753]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da971dcd-5142-4eaa-95af-a475865cddf0 tempest-ServersNegativeTestJSON-693967386 None] Lock "cinder-6b7b1672-61e8-404a-b29e-820a443d8ad6-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:36 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944 Sep 09 16:53:36 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "cinder-66baa217-ee85-4a8b-982d-d1eda8c8bf15-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-66baa217-ee85-4a8b-982d-d1eda8c8bf15-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "cinder-quobyte-66baa217-ee85-4a8b-982d-d1eda8c8bf15" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-quobyte-66baa217-ee85-4a8b-982d-d1eda8c8bf15" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e82b8e-6193-41a7-bde8-7c93d0f85fdc]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:37 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:37 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944 Sep 09 16:53:37 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:37 devstack sudo[98633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15 Sep 09 16:53:37 devstack sudo[98633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (6c9d36f7-0039-42f3-a4d4-980503f628c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489eb5c9-870c-4519-98fe-ec156daf6fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (489eb5c9-870c-4519-98fe-ec156daf6fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1246400564',display_name='tempest-VolumesGetTest-Volume-1194835740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2eee483-283d-4f16-8dcd-2d2f57c18d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:37Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd961158-c2e0-4c0f-8fad-17707d117608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd961158-c2e0-4c0f-8fad-17707d117608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e666baaf-34a8-47b7-9298-167a3d999b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e666baaf-34a8-47b7-9298-167a3d999b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2eee483-283d-4f16-8dcd-2d2f57c18d6c', 'volume_name': 'volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5977aee6-bbf9-4d6e-a23a-38dc7cac2e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5977aee6-bbf9-4d6e-a23a-38dc7cac2e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a56b542-c380-4d15-a790-ba8ba1f14e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Volume c2eee483-283d-4f16-8dcd-2d2f57c18d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c', 'volume_size': 1} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1246400564',display_name='tempest-VolumesGetTest-Volume-1194835740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2eee483-283d-4f16-8dcd-2d2f57c18d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='676cc4d61427423bb369d163f2c94cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:37Z,use_quota=True,user_id='7f384c267e754a09907cc11a6e5c0660',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Creating volume c2eee483-283d-4f16-8dcd-2d2f57c18d6c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:37 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:37 devstack sudo[98633]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ef92c3db-bd21-4a2d-b92e-0e451fbf0944" returned: 0 in 0.449s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15" returned: 0 in 0.542s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:37 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c 1073741824 Sep 09 16:53:37 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Lock "cinder-quobyte-ef92c3db-bd21-4a2d-b92e-0e451fbf0944" released by "delete_volume" :: held 0.986s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:37 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15 Sep 09 16:53:37 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Created reservations ['d4deadc8-603d-4306-8e89-d55b07b34d53', 'b89d3e01-cd77-4963-9327-8836b6b22b94', 'e483c7e4-6c85-4208-9ef3-d9f6a759bc1d', 'f58a7bac-6cb5-408d-bcb3-4929dae8a0cd'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:37 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:37 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:38 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-66baa217-ee85-4a8b-982d-d1eda8c8bf15" returned: 0 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-quobyte-66baa217-ee85-4a8b-982d-d1eda8c8bf15" released by "delete_volume" :: held 0.930s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Created reservations ['8f585c0a-6eae-4053-a593-70e3cd32410e', 'eb59cca2-687f-4a56-9937-3e8c7a13b0ed', 'a5c004e3-e35a-4e74-bec0-f0e72e51325c', '7bada56c-c37f-4cb3-96a0-f2e72c4035c2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:38 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:38 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:38 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Deleted volume successfully. Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d144110-5ffe-4efd-aff9-c96b0c2260ef tempest-ServersNegativeTestJSON-693967386 None] Lock "cinder-ef92c3db-bd21-4a2d-b92e-0e451fbf0944-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:38 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c 1073741824" returned: 0 in 0.671s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:38 devstack sudo[98655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c Sep 09 16:53:38 devstack sudo[98655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:38 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Deleted volume successfully. Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-527a7f0f-c7f5-44b4-96a6-28c588395263 tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-66baa217-ee85-4a8b-982d-d1eda8c8bf15-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:38 devstack sudo[98655]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a56b542-c380-4d15-a790-ba8ba1f14e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7722281e-534f-44bc-8ec7-04d0d0040941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Volume volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c (c2eee483-283d-4f16-8dcd-2d2f57c18d6c): created successfully Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7722281e-534f-44bc-8ec7-04d0d0040941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Flow 'volume_create_manager' (6c9d36f7-0039-42f3-a4d4-980503f628c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fd800f91-2d32-47b1-b0f4-e74ae6b00e7d tempest-VolumesGetTest-1354708599 None] Created volume successfully. Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "cinder-a03ab59a-40d4-419c-9a80-b14d28579824-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-a03ab59a-40d4-419c-9a80-b14d28579824-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "cinder-quobyte-a03ab59a-40d4-419c-9a80-b14d28579824" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-quobyte-a03ab59a-40d4-419c-9a80-b14d28579824" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-c2eee483-283d-4f16-8dcd-2d2f57c18d6c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf47d66-b19c-4689-8c49-7303ab0ee848]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Lock "cinder-c2eee483-283d-4f16-8dcd-2d2f57c18d6c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-quobyte-c2eee483-283d-4f16-8dcd-2d2f57c18d6c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-c2eee483-283d-4f16-8dcd-2d2f57c18d6c" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0188640e-bec4-4664-b523-95d650dcedae]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:40 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824 Sep 09 16:53:40 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:40 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c Sep 09 16:53:40 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:40 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c" returned: 0 in 0.450s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:40 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824" returned: 0 in 0.586s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:40 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c Sep 09 16:53:40 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:40 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824 Sep 09 16:53:40 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:40 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a03ab59a-40d4-419c-9a80-b14d28579824" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:40 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2eee483-283d-4f16-8dcd-2d2f57c18d6c" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-quobyte-a03ab59a-40d4-419c-9a80-b14d28579824" released by "delete_volume" :: held 0.991s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-c2eee483-283d-4f16-8dcd-2d2f57c18d6c" released by "delete_volume" :: held 0.875s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:40 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Created reservations ['2ea1c2e0-c01c-4acf-9f51-71b38819b622', 'ae9a163a-0411-4432-8c3c-06e862507649', 'd3f19b43-9dd0-46c3-87a5-ac04c067c017', '9dd8b582-a8d5-4a24-8a03-ad59382f968d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:40 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Created reservations ['31bf714d-63b7-4446-a561-c31fae7ef7a2', '5b18f5ee-cabb-421f-816b-3fa5f258fb89', 'c736fdff-b0fa-47fc-9999-e2c80e2eab75', '93bc49ec-21d4-4de5-8bb8-cd49b76a7983'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:41 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:41 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:41 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:41 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-c2c02a6b-8014-4266-93b5-0fe8f112808f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Lock "cinder-c2c02a6b-8014-4266-93b5-0fe8f112808f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Acquiring lock "cinder-quobyte-c2c02a6b-8014-4266-93b5-0fe8f112808f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-c2c02a6b-8014-4266-93b5-0fe8f112808f" acquired by "delete_volume" :: waited 0.056s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04b32cf-efcc-4121-8342-138c9ad53e87]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:41 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.544s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Deleted volume successfully. Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-68f77bc1-036b-4256-969f-3ca9e2d1440c tempest-AttachVolumeNegativeTest-1647988275 None] Lock "cinder-a03ab59a-40d4-419c-9a80-b14d28579824-delete_volume" released by "delete_volume" :: held 1.944s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:41 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.555s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Deleted volume successfully. Sep 09 16:53:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-179cfe0f-4440-4e23-a1d5-a3e2c2a10e3a tempest-VolumesGetTest-1354708599 None] Lock "cinder-c2eee483-283d-4f16-8dcd-2d2f57c18d6c-delete_volume" released by "delete_volume" :: held 1.838s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:41 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f Sep 09 16:53:41 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:42 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f" returned: 0 in 0.500s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:42 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f Sep 09 16:53:42 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:42 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c2c02a6b-8014-4266-93b5-0fe8f112808f" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Lock "cinder-quobyte-c2c02a6b-8014-4266-93b5-0fe8f112808f" released by "delete_volume" :: held 0.934s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Created reservations ['c37faf24-5cfe-41c1-a9f2-3dec79e0b69e', '4ba4666e-827b-4a50-b69a-6dc96e204509', 'b358dd78-7ecc-4784-b276-1c85b121912f', '541aae16-9823-4c05-87f1-ac331e133e68'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:42 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:42 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:42 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Deleted volume successfully. Sep 09 16:53:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a799b417-e0ac-4fa2-9b42-1b8cda160091 tempest-VolumesGetTest-1354708599 None] Lock "cinder-c2c02a6b-8014-4266-93b5-0fe8f112808f-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:45 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:45 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:45 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:53:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:53:52 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=149,cinder:INSERT=46,cinder:DELETE=14,cinder:SELECT=87 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:53:52 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=55,cinder:DELETE=7,cinder:SELECT=56,cinder:INSERT=16 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Flow 'volume_create_manager' (4e2c46d6-bea8-40cc-99ff-9cce6b888d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06143a63-45b4-45d4-8a02-340e08f87248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06143a63-45b4-45d4-8a02-340e08f87248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-234556900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c31303e-58b7-4037-81bb-e06b9ee79218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bcb06f24eb542e0bdabf5c88144e2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:54Z,use_quota=True,user_id='8e00c55cd1164f4080d3dd7ba64d01af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97803592-98c6-4025-ac01-638759769fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97803592-98c6-4025-ac01-638759769fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad6159b-ab2d-4fea-9fba-ac0dab9be868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aad6159b-ab2d-4fea-9fba-ac0dab9be868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c31303e-58b7-4037-81bb-e06b9ee79218', 'volume_name': 'volume-9c31303e-58b7-4037-81bb-e06b9ee79218', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76507d4d-a2f1-4eda-aa41-f597c6cc1976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76507d4d-a2f1-4eda-aa41-f597c6cc1976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0a90aa-5528-4776-94cc-58c61e6716b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Volume 9c31303e-58b7-4037-81bb-e06b9ee79218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c31303e-58b7-4037-81bb-e06b9ee79218', 'volume_size': 1} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-234556900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c31303e-58b7-4037-81bb-e06b9ee79218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bcb06f24eb542e0bdabf5c88144e2b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:54Z,use_quota=True,user_id='8e00c55cd1164f4080d3dd7ba64d01af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Creating volume 9c31303e-58b7-4037-81bb-e06b9ee79218 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:54 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:54 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 1073741824 Sep 09 16:53:54 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:54 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 1073741824" returned: 0 in 0.485s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:54 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 Sep 09 16:53:54 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:55 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf0a90aa-5528-4776-94cc-58c61e6716b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c31303e-58b7-4037-81bb-e06b9ee79218', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf121a5-f74b-44d1-aff2-a69453b28cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Volume volume-9c31303e-58b7-4037-81bb-e06b9ee79218 (9c31303e-58b7-4037-81bb-e06b9ee79218): created successfully Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf121a5-f74b-44d1-aff2-a69453b28cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Flow 'volume_create_manager' (4e2c46d6-bea8-40cc-99ff-9cce6b888d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1ea5474a-151b-4095-9687-2eecca3d6963 tempest-SnapshotMetadataTestJSON-156834628 None] Created volume successfully. Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Flow 'volume_create_manager' (8987e3f3-5eea-4dbb-a6c6-3662d6aa79ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba22617-038f-49ca-8288-c6d44534cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba22617-038f-49ca-8288-c6d44534cec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-558085948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e787f8a4-b2c7-42dd-87dd-d990604ebd16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='340dd6c9e9b6480b8152adf01a128766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:56Z,use_quota=True,user_id='ff8b1e02c2894b10a23afa9a51b6a0fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17474174-724e-450b-8ce8-f28b9891c3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17474174-724e-450b-8ce8-f28b9891c3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224e8c3a-eb72-4994-a4f0-8235cfb281c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (224e8c3a-eb72-4994-a4f0-8235cfb281c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e787f8a4-b2c7-42dd-87dd-d990604ebd16', 'volume_name': 'volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b596f3f-fda0-4ed5-bbac-19c15c8fc8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b596f3f-fda0-4ed5-bbac-19c15c8fc8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f37dab9-610f-499f-a2d1-ad0b0bd01b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Volume e787f8a4-b2c7-42dd-87dd-d990604ebd16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16', 'volume_size': 1} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-558085948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e787f8a4-b2c7-42dd-87dd-d990604ebd16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='340dd6c9e9b6480b8152adf01a128766',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:56Z,use_quota=True,user_id='ff8b1e02c2894b10a23afa9a51b6a0fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Creating volume e787f8a4-b2c7-42dd-87dd-d990604ebd16 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:55 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16 1073741824 Sep 09 16:53:55 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Flow 'volume_create_manager' (44f4af33-4b4e-40e7-aa32-3e4b6677cc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c52911-6036-4b44-a78a-d99897bea5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c52911-6036-4b44-a78a-d99897bea5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-214697621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a6e200-6995-47a2-b061-ade811c93508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c747788ef4944cb7ba82a4ba13de83a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:56Z,use_quota=True,user_id='e922f2ecf3ec45579d50cb455dcf6eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8e332c-34e9-4982-9128-0fc41a5c77c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8e332c-34e9-4982-9128-0fc41a5c77c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64382162-5646-4c08-8993-57699511bf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64382162-5646-4c08-8993-57699511bf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9a6e200-6995-47a2-b061-ade811c93508', 'volume_name': 'volume-a9a6e200-6995-47a2-b061-ade811c93508', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee7a5a4-df19-4b2c-8a1c-9b9f6831125d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee7a5a4-df19-4b2c-8a1c-9b9f6831125d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1abb4d1-ae4c-4043-8738-7280fbf9fe07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Volume a9a6e200-6995-47a2-b061-ade811c93508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9a6e200-6995-47a2-b061-ade811c93508', 'volume_size': 1} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:56 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16 1073741824" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:56 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16 Sep 09 16:53:56 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:56 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16" returned: 0 in 0.261s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.488s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f37dab9-610f-499f-a2d1-ad0b0bd01b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0378037e-8e72-4836-9115-7f2adc5ba293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Creating offline snapshot 7f12a687-ad3a-48b7-8d27-8072777b95ba of volume 9c31303e-58b7-4037-81bb-e06b9ee79218 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:53:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Volume volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16 (e787f8a4-b2c7-42dd-87dd-d990604ebd16): created successfully Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0378037e-8e72-4836-9115-7f2adc5ba293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Flow 'volume_create_manager' (8987e3f3-5eea-4dbb-a6c6-3662d6aa79ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b968f16-02ff-4f9a-9583-9c2f9ef69fdd]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-6b500ca6-d871-409f-8d84-f3b278b9fcaf req-94cd0197-b6c9-41fc-84d7-e4a2e8ad43e8 tempest-VolumesGetTestJSON-373775300 None] Created volume successfully. Sep 09 16:53:56 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 Sep 09 16:53:56 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:57 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:57 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba 1G Sep 09 16:53:57 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Acquiring lock "cinder-e787f8a4-b2c7-42dd-87dd-d990604ebd16-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Lock "cinder-e787f8a4-b2c7-42dd-87dd-d990604ebd16-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Acquiring lock "cinder-quobyte-e787f8a4-b2c7-42dd-87dd-d990604ebd16" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Lock "cinder-quobyte-e787f8a4-b2c7-42dd-87dd-d990604ebd16" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9dd2e7-521f-43dc-bff0-9e5b7e37bbaf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:57 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba 1G" returned: 0 in 0.510s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c31303e-58b7-4037-81bb-e06b9ee79218 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:57 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16 Sep 09 16:53:57 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:57 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c31303e-58b7-4037-81bb-e06b9ee79218 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba Sep 09 16:53:57 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:57 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:57 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c31303e-58b7-4037-81bb-e06b9ee79218 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:57 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba is being set with open permissions: ugo+rw Sep 09 16:53:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:57 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16 Sep 09 16:53:57 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:58 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba Sep 09 16:53:58 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:58 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e787f8a4-b2c7-42dd-87dd-d990604ebd16" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Lock "cinder-quobyte-e787f8a4-b2c7-42dd-87dd-d990604ebd16" released by "delete_volume" :: held 0.752s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:58 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:58 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.info Sep 09 16:53:58 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.quota [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Created reservations ['20ebf846-228e-4221-94ce-0a8f6e0d7414', 'd3ff20d6-20c7-43d8-a8f3-9f9ece19c3d9', 'd658ddb3-1d53-43e3-af9e-ff7fe425a8b0', '6e3c9bea-5032-4e3e-92ab-9a1d8c5ada89'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:58 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:53:58 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:58 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.info" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:58 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.info is being set with open permissions: ugo+rw Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:58 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.info Sep 09 16:53:58 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:58 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.manager [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:53:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Deleted volume successfully. Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-18913fdb-c08f-47f4-aae1-2f38b3553ec9 req-890c03e5-8ac6-42e0-bcd0-d43c59b5d920 tempest-VolumesGetTestJSON-373775300 None] Lock "cinder-e787f8a4-b2c7-42dd-87dd-d990604ebd16-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:53:58 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.info" returned: 0 in 0.266s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.226s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.605s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-214697621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9a6e200-6995-47a2-b061-ade811c93508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c747788ef4944cb7ba82a4ba13de83a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:53:56Z,use_quota=True,user_id='e922f2ecf3ec45579d50cb455dcf6eb3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Creating volume a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:53:58 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:53:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:58 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 1073741824 Sep 09 16:53:58 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2f2e5b99-01d8-4ff7-93fa-b66ec1f7a184 tempest-SnapshotMetadataTestJSON-156834628 None] Create snapshot completed successfully Sep 09 16:53:59 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 1073741824" returned: 0 in 0.499s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:53:59 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 Sep 09 16:53:59 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:53:59 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Sep 09 16:53:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:53:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:53:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:53:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1abb4d1-ae4c-4043-8738-7280fbf9fe07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9a6e200-6995-47a2-b061-ade811c93508', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725cf450-0a67-4c44-acd3-ee62735add36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:53:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Volume volume-a9a6e200-6995-47a2-b061-ade811c93508 (a9a6e200-6995-47a2-b061-ade811c93508): created successfully Sep 09 16:53:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725cf450-0a67-4c44-acd3-ee62735add36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:53:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Flow 'volume_create_manager' (44f4af33-4b4e-40e7-aa32-3e4b6677cc45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:53:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5816a39a-66b4-4ff7-93d6-b31930778362 tempest-VolumesSnapshotListTestJSON-44111945 None] Created volume successfully. Sep 09 16:54:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Creating offline snapshot 85cc79c5-6208-4f22-b475-85dc1251b4f6 of volume a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:54:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d15b48f-b412-4a92-a896-63e00bd5b7bf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:00 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 Sep 09 16:54:00 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:01 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508" returned: 0 in 0.427s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:01 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 1G Sep 09 16:54:01 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Acquiring lock "cinder-7f12a687-ad3a-48b7-8d27-8072777b95ba-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Lock "cinder-7f12a687-ad3a-48b7-8d27-8072777b95ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Acquiring lock "cinder-quobyte-9c31303e-58b7-4037-81bb-e06b9ee79218" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Lock "cinder-quobyte-9c31303e-58b7-4037-81bb-e06b9ee79218" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Acquiring lock "cinder-quobyte-7f12a687-ad3a-48b7-8d27-8072777b95ba" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Lock "cinder-quobyte-7f12a687-ad3a-48b7-8d27-8072777b95ba" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Deleting offline snapshot 7f12a687-ad3a-48b7-8d27-8072777b95ba of volume 9c31303e-58b7-4037-81bb-e06b9ee79218 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] snapshot_file for this snap is: volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09c220d-6bc3-4ac7-91ab-7c72236b5811]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:01 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 1G" returned: 0 in 0.592s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a6e200-6995-47a2-b061-ade811c93508 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:01 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a6e200-6995-47a2-b061-ade811c93508 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 Sep 09 16:54:01 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:01 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba Sep 09 16:54:01 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:01 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a6e200-6995-47a2-b061-ade811c93508 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:01 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 is being set with open permissions: ugo+rw Sep 09 16:54:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:02 devstack sudo[98829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 Sep 09 16:54:02 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:02 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba" returned: 0 in 0.552s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c31303e-58b7-4037-81bb-e06b9ee79218(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[87123438-4398-4777-9b2c-b6eb32a5f092]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:02 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 Sep 09 16:54:02 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:02 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:02 devstack sudo[98834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.info Sep 09 16:54:02 devstack sudo[98834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:02 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218" returned: 0 in 0.455s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:02 devstack sudo[98840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba Sep 09 16:54:02 devstack sudo[98840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:02 devstack sudo[98834]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.info" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:02 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.info is being set with open permissions: ugo+rw Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:02 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.info Sep 09 16:54:02 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:02 devstack sudo[98840]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba" returned: 0 in 0.431s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:02 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba Sep 09 16:54:02 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:03 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.info" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.515s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-48818255-ca18-4094-86fa-372d47866bb3 tempest-VolumesSnapshotListTestJSON-44111945 None] Create snapshot completed successfully Sep 09 16:54:03 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218.7f12a687-ad3a-48b7-8d27-8072777b95ba" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Lock "cinder-quobyte-7f12a687-ad3a-48b7-8d27-8072777b95ba" released by "_delete_snapshot" :: held 1.892s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Lock "cinder-quobyte-9c31303e-58b7-4037-81bb-e06b9ee79218" released by "delete_snapshot" :: held 1.920s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Created reservations ['e8cc9d3a-f01f-4c11-afdc-899e7d4d7d19', '4e080826-c8cc-44c4-b4c2-e89ea522f788', '4365c5d9-0e08-4da3-86c9-a0884a2d2c5d', '03518e16-72ff-4478-a292-765b49505bfa'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Delete snapshot completed successfully. Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e0dd2c4b-3d42-4bc9-987b-f62d385ded3e tempest-SnapshotMetadataTestJSON-156834628 None] Lock "cinder-7f12a687-ad3a-48b7-8d27-8072777b95ba-delete_snapshot" released by "delete_snapshot" :: held 2.121s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Acquiring lock "cinder-9c31303e-58b7-4037-81bb-e06b9ee79218-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "cinder-9c31303e-58b7-4037-81bb-e06b9ee79218-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Acquiring lock "cinder-quobyte-9c31303e-58b7-4037-81bb-e06b9ee79218" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Flow 'volume_create_manager' (2a2d269c-6a4d-4d7f-8289-d4a54409bee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18323b3b-e727-4288-943f-9ffe8edd3c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18323b3b-e727-4288-943f-9ffe8edd3c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-486429815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d96bbe0-4023-4314-83f5-cf9923802793,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab461402d59e457a8dac9567f9f0d009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:04Z,use_quota=True,user_id='63031aba21164282b270e47fc05db9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c960c974-34d6-40ed-a645-8b9fbd92460b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c960c974-34d6-40ed-a645-8b9fbd92460b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392091db-00ec-4323-96cb-85ada28084cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (392091db-00ec-4323-96cb-85ada28084cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d96bbe0-4023-4314-83f5-cf9923802793', 'volume_name': 'volume-5d96bbe0-4023-4314-83f5-cf9923802793', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b6f3f6-1945-49ba-924c-19ad3a901800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b6f3f6-1945-49ba-924c-19ad3a901800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884b1d5a-1488-4bb6-bdcc-45d79e127198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Volume 5d96bbe0-4023-4314-83f5-cf9923802793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d96bbe0-4023-4314-83f5-cf9923802793', 'volume_size': 1} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-486429815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d96bbe0-4023-4314-83f5-cf9923802793,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab461402d59e457a8dac9567f9f0d009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:04Z,use_quota=True,user_id='63031aba21164282b270e47fc05db9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Creating volume 5d96bbe0-4023-4314-83f5-cf9923802793 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:03 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "cinder-quobyte-9c31303e-58b7-4037-81bb-e06b9ee79218" acquired by "delete_volume" :: waited 0.155s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:03 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793 1073741824 Sep 09 16:54:03 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8f4db2-732a-461a-a796-a50e80110c04]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:04 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 Sep 09 16:54:04 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:04 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793 1073741824" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:04 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:04 devstack sudo[98863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793 Sep 09 16:54:04 devstack sudo[98863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:04 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218 Sep 09 16:54:04 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:04 devstack sudo[98863]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:04 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.686s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9c31303e-58b7-4037-81bb-e06b9ee79218" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] Creating offline snapshot b975fd8e-ee3f-4297-8098-d2636c28050b of volume a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (884b1d5a-1488-4bb6-bdcc-45d79e127198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d96bbe0-4023-4314-83f5-cf9923802793', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b59c13c-580f-4ef4-af15-ef8cf657ab06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c5845a-dcea-400f-85d7-bc4a0ddde9a5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "cinder-quobyte-9c31303e-58b7-4037-81bb-e06b9ee79218" released by "delete_volume" :: held 0.874s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Volume volume-5d96bbe0-4023-4314-83f5-cf9923802793 (5d96bbe0-4023-4314-83f5-cf9923802793): created successfully Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b59c13c-580f-4ef4-af15-ef8cf657ab06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Flow 'volume_create_manager' (2a2d269c-6a4d-4d7f-8289-d4a54409bee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1cc68eac-b1e1-471b-8e19-0e041d5a8453 tempest-VolumesTestJSON-300154242 None] Created volume successfully. Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Created reservations ['181cb651-8af9-4553-9a14-74a8b9e190db', '92f3b668-5879-4b43-9ced-d1fd092724cd', 'b1de3a5e-727a-436d-a9a5-bc94667a084a', '13c7d750-15a4-4e59-8658-b9b853357f2e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:04 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 Sep 09 16:54:04 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:05 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:05 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:05 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6" returned: 0 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a6e200-6995-47a2-b061-ade811c93508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:05 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b 1G Sep 09 16:54:05 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:05 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:05 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Deleted volume successfully. Sep 09 16:54:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-315e3ea8-461b-4ff5-ab6c-b6a251a55858 tempest-SnapshotMetadataTestJSON-156834628 None] Lock "cinder-9c31303e-58b7-4037-81bb-e06b9ee79218-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:05 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b 1G" returned: 0 in 0.441s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:05 devstack sudo[98883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b Sep 09 16:54:05 devstack sudo[98883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:06 devstack sudo[98883]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:06 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b is being set with open permissions: ugo+rw Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:06 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b Sep 09 16:54:06 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:06 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b" returned: 0 in 0.450s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.831s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dd3e6b47-298e-4814-8950-8c007c0b1232 tempest-VolumesSnapshotListTestJSON-44111945 None] Create snapshot completed successfully Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Flow 'volume_create_manager' (8da447df-a234-4c99-9ed8-2bdfdfc8d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debeb1a0-8f1f-44c3-ad00-67655f918200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (debeb1a0-8f1f-44c3-ad00-67655f918200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-139939966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310e1e75-0d71-431d-ba30-6437d1abc161,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab461402d59e457a8dac9567f9f0d009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:07Z,use_quota=True,user_id='63031aba21164282b270e47fc05db9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c23fa6c-7c65-4a50-a615-d7838d3f6d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c23fa6c-7c65-4a50-a615-d7838d3f6d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c69661-fa28-40d6-8406-0c0e47e7a226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c69661-fa28-40d6-8406-0c0e47e7a226) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '310e1e75-0d71-431d-ba30-6437d1abc161', 'volume_name': 'volume-310e1e75-0d71-431d-ba30-6437d1abc161', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d0e7bd-d620-43db-93d8-7c60bcc41bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20d0e7bd-d620-43db-93d8-7c60bcc41bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf99adc-4ee9-4f29-be43-f032f9175061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Volume 310e1e75-0d71-431d-ba30-6437d1abc161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-310e1e75-0d71-431d-ba30-6437d1abc161', 'volume_size': 1} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-139939966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=310e1e75-0d71-431d-ba30-6437d1abc161,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab461402d59e457a8dac9567f9f0d009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:07Z,use_quota=True,user_id='63031aba21164282b270e47fc05db9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Creating volume 310e1e75-0d71-431d-ba30-6437d1abc161 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:06 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:06 devstack sudo[98891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161 1073741824 Sep 09 16:54:06 devstack sudo[98891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:07 devstack sudo[98891]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161 1073741824" returned: 0 in 0.593s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:07 devstack sudo[98897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161 Sep 09 16:54:07 devstack sudo[98897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:07 devstack sudo[98897]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf99adc-4ee9-4f29-be43-f032f9175061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-310e1e75-0d71-431d-ba30-6437d1abc161', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6148fcc6-ca69-47c4-b028-3243d5aa9d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Volume volume-310e1e75-0d71-431d-ba30-6437d1abc161 (310e1e75-0d71-431d-ba30-6437d1abc161): created successfully Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6148fcc6-ca69-47c4-b028-3243d5aa9d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Flow 'volume_create_manager' (8da447df-a234-4c99-9ed8-2bdfdfc8d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Flow 'volume_create_manager' (64be8281-986d-403c-b38c-fa52c59c484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26a251d-b82f-4c99-adbe-dcdde8bd9546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] Creating offline snapshot c386e157-0e2e-4579-8ee3-1161997931d9 of volume a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b26a251d-b82f-4c99-adbe-dcdde8bd9546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1170902115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0dd1b7812545d095a35fa861850d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:08Z,use_quota=True,user_id='c39f27a2fe784782ad8dfdc6a3b6718d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e31a99c5-85fc-4834-b1a5-c6a6d3f56f54),volume_type_id=e31a99c5-85fc-4834-b1a5-c6a6d3f56f54)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a73f866-e83f-4f36-8224-70e85bd77dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a73f866-e83f-4f36-8224-70e85bd77dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01a3ba4-21fc-40fa-89f1-591e38194374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f01a3ba4-21fc-40fa-89f1-591e38194374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66', 'volume_name': 'volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f79e6ac-cfff-4064-943d-ba3f8e7c5aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f79e6ac-cfff-4064-943d-ba3f8e7c5aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0414837d-a4bb-4b83-a623-d361c234ac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Volume c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66', 'volume_size': 1} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93d9fc2-548f-4478-a1a2-269868af7c1e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d91d398e-3af1-4140-8369-8240b4803496 tempest-VolumesTestJSON-300154242 None] Created volume successfully. Sep 09 16:54:07 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b Sep 09 16:54:07 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:08 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b" returned: 0 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a6e200-6995-47a2-b061-ade811c93508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:08 devstack sudo[98906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 1G Sep 09 16:54:08 devstack sudo[98906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:08 devstack sudo[98906]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 1G" returned: 0 in 0.530s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:08 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 Sep 09 16:54:08 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:09 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 is being set with open permissions: ugo+rw Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:09 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 Sep 09 16:54:09 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Flow 'volume_create_manager' (9c8d8df8-48b5-4299-873d-bda441c7f713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edf1b25-8c3c-457e-a3f5-17b0ecd4d2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4edf1b25-8c3c-457e-a3f5-17b0ecd4d2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1846241596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb7a903-d603-4482-98d8-eb9099e319dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab461402d59e457a8dac9567f9f0d009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:09Z,use_quota=True,user_id='63031aba21164282b270e47fc05db9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148644d7-69eb-4ce2-9866-a79dc7292ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148644d7-69eb-4ce2-9866-a79dc7292ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49f082e-b7ad-40ca-82a9-21a4996fcdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49f082e-b7ad-40ca-82a9-21a4996fcdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb7a903-d603-4482-98d8-eb9099e319dc', 'volume_name': 'volume-eeb7a903-d603-4482-98d8-eb9099e319dc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a140dec5-a379-468c-b992-48965db287a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a140dec5-a379-468c-b992-48965db287a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b5aa05-71ff-41f8-a4f5-467577e9a9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Volume eeb7a903-d603-4482-98d8-eb9099e319dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb7a903-d603-4482-98d8-eb9099e319dc', 'volume_size': 1} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:09 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.742s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.587s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1170902115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a0dd1b7812545d095a35fa861850d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:08Z,use_quota=True,user_id='c39f27a2fe784782ad8dfdc6a3b6718d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e31a99c5-85fc-4834-b1a5-c6a6d3f56f54),volume_type_id=e31a99c5-85fc-4834-b1a5-c6a6d3f56f54)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Creating volume c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:09 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:09 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 1073741824 Sep 09 16:54:09 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d177d946-fff0-450d-aa3c-921e688ab3d5 tempest-VolumesSnapshotListTestJSON-44111945 None] Create snapshot completed successfully Sep 09 16:54:09 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 1073741824" returned: 0 in 0.469s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:10 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 Sep 09 16:54:10 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:10 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Flow 'volume_create_manager' (fe63cb0d-0d3c-4e45-b692-9721ffc81a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4753c1f4-238f-43b4-96ad-3f38e1ad1321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1846241596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb7a903-d603-4482-98d8-eb9099e319dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab461402d59e457a8dac9567f9f0d009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:09Z,use_quota=True,user_id='63031aba21164282b270e47fc05db9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Creating volume eeb7a903-d603-4482-98d8-eb9099e319dc {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:10 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4753c1f4-238f-43b4-96ad-3f38e1ad1321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-732584455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3963b4c-f298-4e7e-9c7e-6e7dcf809a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9740b7a32b452b9dec0d72bb335f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:10Z,use_quota=True,user_id='db379f4e38d7410e923dd1daf0777997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:10 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc 1073741824 Sep 09 16:54:10 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba7c89f-5c59-4563-b2cf-5a91429a4f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba7c89f-5c59-4563-b2cf-5a91429a4f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ab532a-cd94-476f-9a81-cb145a62f77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33ab532a-cd94-476f-9a81-cb145a62f77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3963b4c-f298-4e7e-9c7e-6e7dcf809a36', 'volume_name': 'volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f8ee82-3f5f-442f-bde8-6a705a9ab0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f8ee82-3f5f-442f-bde8-6a705a9ab0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e2efeb-27d2-4ec5-822a-19a2af24b5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Volume f3963b4c-f298-4e7e-9c7e-6e7dcf809a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36', 'volume_size': 1} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0414837d-a4bb-4b83-a623-d361c234ac43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9192cf7-2811-45cc-bcdf-8d481e3532ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Volume volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 (c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66): created successfully Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9192cf7-2811-45cc-bcdf-8d481e3532ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Flow 'volume_create_manager' (64be8281-986d-403c-b38c-fa52c59c484f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-92764dcd-2bb9-4249-a1bb-68897153c007 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Created volume successfully. Sep 09 16:54:10 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc 1073741824" returned: 0 in 0.507s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:10 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc Sep 09 16:54:10 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:11 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-732584455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3963b4c-f298-4e7e-9c7e-6e7dcf809a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9740b7a32b452b9dec0d72bb335f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:10Z,use_quota=True,user_id='db379f4e38d7410e923dd1daf0777997',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Creating volume f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:11 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b5aa05-71ff-41f8-a4f5-467577e9a9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb7a903-d603-4482-98d8-eb9099e319dc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:11 devstack sudo[98938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 1073741824 Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa4b8a4-1b38-489d-905b-04a6f767c28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:11 devstack sudo[98938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Volume volume-eeb7a903-d603-4482-98d8-eb9099e319dc (eeb7a903-d603-4482-98d8-eb9099e319dc): created successfully Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afa4b8a4-1b38-489d-905b-04a6f767c28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Flow 'volume_create_manager' (9c8d8df8-48b5-4299-873d-bda441c7f713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0646ba6e-62d1-40d0-bb41-3dd2db9062a4 tempest-VolumesTestJSON-300154242 None] Created volume successfully. Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7a384b7-5345-4b23-8081-c9ae52f63807 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7a384b7-5345-4b23-8081-c9ae52f63807 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7a384b7-5345-4b23-8081-c9ae52f63807 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7a384b7-5345-4b23-8081-c9ae52f63807 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7a384b7-5345-4b23-8081-c9ae52f63807 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7a384b7-5345-4b23-8081-c9ae52f63807 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:11 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:11 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:11 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7a384b7-5345-4b23-8081-c9ae52f63807 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c7a384b7-5345-4b23-8081-c9ae52f63807 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c7a384b7-5345-4b23-8081-c9ae52f63807 tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Retype volume completed successfully. Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-c386e157-0e2e-4579-8ee3-1161997931d9-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-c386e157-0e2e-4579-8ee3-1161997931d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-quobyte-c386e157-0e2e-4579-8ee3-1161997931d9" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-c386e157-0e2e-4579-8ee3-1161997931d9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Deleting offline snapshot c386e157-0e2e-4579-8ee3-1161997931d9 of volume a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] snapshot_file for this snap is: volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf30a7cc-c0a5-41f1-bc53-e8b0c2d396f2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:11 devstack sudo[98938]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 1073741824" returned: 0 in 0.596s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:11 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 Sep 09 16:54:11 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:11 devstack sudo[98946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 Sep 09 16:54:11 devstack sudo[98946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:12 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:12 devstack sudo[98946]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a6e200-6995-47a2-b061-ade811c93508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e2efeb-27d2-4ec5-822a-19a2af24b5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fc62a7-b738-4ce2-80df-8002242a6650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d859c2-a28a-486b-b82d-63902c9d0f35]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Volume volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 (f3963b4c-f298-4e7e-9c7e-6e7dcf809a36): created successfully Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77fc62a7-b738-4ce2-80df-8002242a6650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Flow 'volume_create_manager' (fe63cb0d-0d3c-4e45-b692-9721ffc81a83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8033f67c-aabd-4984-9c0c-1f0b3d48f82e tempest-VolumesMetadataTest-1006678384 None] Created volume successfully. Sep 09 16:54:12 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b Sep 09 16:54:12 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Acquiring lock "cinder-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "cinder-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Acquiring lock "cinder-eeb7a903-d603-4482-98d8-eb9099e319dc-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Acquiring lock "cinder-quobyte-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Lock "cinder-eeb7a903-d603-4482-98d8-eb9099e319dc-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "cinder-quobyte-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[06900437-42b5-47c9-9173-f84d14800344]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Acquiring lock "cinder-quobyte-eeb7a903-d603-4482-98d8-eb9099e319dc" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Lock "cinder-quobyte-eeb7a903-d603-4482-98d8-eb9099e319dc" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9751ba-4719-47cd-b23f-37db3ac3038b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:12 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b" returned: 0 in 0.576s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a6e200-6995-47a2-b061-ade811c93508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:12 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 Sep 09 16:54:12 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:12 devstack sudo[98965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 Sep 09 16:54:12 devstack sudo[98965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:12 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc Sep 09 16:54:12 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:13 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66" returned: 0 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:13 devstack sudo[98976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66 Sep 09 16:54:13 devstack sudo[98976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:13 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc" returned: 0 in 0.377s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:13 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc Sep 09 16:54:13 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:13 devstack sudo[98965]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:13 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9 Sep 09 16:54:13 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:13 devstack sudo[98976]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66" returned: 0 in 0.289s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "cinder-quobyte-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66" released by "delete_volume" :: held 0.744s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:13 devstack cinder-volume[87498]: WARNING cinder.quota [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:54:13 devstack cinder-volume[87498]: WARNING cinder.quota [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:54:13 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eeb7a903-d603-4482-98d8-eb9099e319dc" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Created reservations ['fc0b425d-bfaf-4aea-afa6-58f3d2f3467a', 'c741e086-a0c7-4446-a3d5-514bc94199df', '1f8085d8-ff24-436c-bbaf-5c08dbf76f4c', 'fe03b151-fd6b-418c-be6f-62aaf9bba899'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Lock "cinder-quobyte-eeb7a903-d603-4482-98d8-eb9099e319dc" released by "delete_volume" :: held 0.727s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:13 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.c386e157-0e2e-4579-8ee3-1161997931d9" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-c386e157-0e2e-4579-8ee3-1161997931d9" released by "_delete_snapshot" :: held 1.912s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" released by "delete_snapshot" :: held 1.940s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Created reservations ['46827c26-69a5-40f0-93ad-e2b75b3da5f3', '528b1a95-5cea-40f8-9d23-577ac6eaf9f7', '4a9f82e3-97d3-4b43-bb2b-f2d160779782', '0178ecda-4fbd-4c1d-bd31-e6c3ea6ee441'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:13 devstack sudo[98987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:13 devstack sudo[98987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Created reservations ['354b74a7-93f7-4af6-b81e-4e0b9dfd26c4', '0c52d14b-b0a2-42e2-b0ac-648db273f940', '2c9e6480-2f2e-404e-ae43-225aed2c27f5', '45b5e54a-ba4d-4db3-b4f0-705d815a323f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:13 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:13 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Delete snapshot completed successfully. Sep 09 16:54:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79f08c89-3ad4-4af9-a91a-d9bd250a195f tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-c386e157-0e2e-4579-8ee3-1161997931d9-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:14 devstack sudo[98987]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Deleted volume successfully. Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c5a5ddc4-06f1-4879-9097-bb1c4241223a tempest-VolumeRetypeWithoutMigrationTest-412518161 None] Lock "cinder-c6a8cbf3-7bd8-4008-8f5c-3b5c06651c66-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:14 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Deleted volume successfully. Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bed08a2-9380-48bb-b5bb-5e11821d90b1 tempest-VolumesTestJSON-300154242 None] Lock "cinder-eeb7a903-d603-4482-98d8-eb9099e319dc-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Acquiring lock "cinder-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Lock "cinder-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Acquiring lock "cinder-quobyte-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Lock "cinder-quobyte-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[757bb9e7-b22c-4d18-bc47-cc1a97c45957]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:14 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 Sep 09 16:54:14 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Acquiring lock "cinder-310e1e75-0d71-431d-ba30-6437d1abc161-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Lock "cinder-310e1e75-0d71-431d-ba30-6437d1abc161-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-b975fd8e-ee3f-4297-8098-d2636c28050b-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-b975fd8e-ee3f-4297-8098-d2636c28050b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:15 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-quobyte-b975fd8e-ee3f-4297-8098-d2636c28050b" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Acquiring lock "cinder-quobyte-310e1e75-0d71-431d-ba30-6437d1abc161" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36" returned: 0 in 0.469s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-b975fd8e-ee3f-4297-8098-d2636c28050b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:15 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36 Sep 09 16:54:15 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Deleting offline snapshot b975fd8e-ee3f-4297-8098-d2636c28050b of volume a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] snapshot_file for this snap is: volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Lock "cinder-quobyte-310e1e75-0d71-431d-ba30-6437d1abc161" acquired by "delete_volume" :: waited 0.057s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6402beaa-285b-4eaf-9020-dd782e772c9a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f6808c-df0a-4e2e-a8a1-54a8ddecabf0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:15 devstack sudo[99002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b Sep 09 16:54:15 devstack sudo[99002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:15 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161 Sep 09 16:54:15 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:15 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Lock "cinder-quobyte-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36" released by "delete_volume" :: held 0.817s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Created reservations ['31683c50-01ae-41f0-a7d3-7947c0d90cb7', 'f9174dbc-24e5-4cd4-b8b4-8d52d9d4a2c6', '2d9d57cc-3979-4072-9a63-c71427bfd77f', '541eac4d-07c8-4479-9a20-d76888053fef'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:15 devstack sudo[99013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:15 devstack sudo[99013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:15 devstack sudo[99002]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b" returned: 0 in 0.479s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a6e200-6995-47a2-b061-ade811c93508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:15 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161" returned: 0 in 0.501s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72d0087-57f1-440e-b08c-366000927351]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:15 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161 Sep 09 16:54:15 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:15 devstack sudo[99016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 Sep 09 16:54:15 devstack sudo[99016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:15 devstack sudo[99013]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Deleted volume successfully. Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c364cbe-f4a0-4cb5-86e2-b2733fec8629 tempest-VolumesMetadataTest-1006678384 None] Lock "cinder-f3963b4c-f298-4e7e-9c7e-6e7dcf809a36-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:15 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-310e1e75-0d71-431d-ba30-6437d1abc161" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Lock "cinder-quobyte-310e1e75-0d71-431d-ba30-6437d1abc161" released by "delete_volume" :: held 0.920s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Created reservations ['47c25b08-7a8e-484a-bdb4-a08595de3fe6', '8c6c4f3a-abe8-453c-a6ab-d6184cf8fa04', '271e456f-fffe-40f2-a707-19a322d847e4', '69070573-92c7-4879-8f8f-6527b18a9e55'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:16 devstack sudo[99016]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6" returned: 0 in 0.593s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a6e200-6995-47a2-b061-ade811c93508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:16 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:16 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:16 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b Sep 09 16:54:16 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:16 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.367s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Deleted volume successfully. Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a36da0dd-37bb-4578-85f3-191df789a247 tempest-VolumesTestJSON-300154242 None] Lock "cinder-310e1e75-0d71-431d-ba30-6437d1abc161-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:16 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:16 devstack sudo[99033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b Sep 09 16:54:16 devstack sudo[99033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:17 devstack sudo[99033]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.b975fd8e-ee3f-4297-8098-d2636c28050b" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-b975fd8e-ee3f-4297-8098-d2636c28050b" released by "_delete_snapshot" :: held 2.040s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" released by "delete_snapshot" :: held 2.080s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Created reservations ['72156a9e-faf1-4945-b82d-3f53623a5a4e', '3c8a5327-d1c5-4fdc-85a4-3b78cf2340e9', 'eb43ac1d-7339-4e99-af21-809d03bff062', '7d30d10a-e241-4f7c-a7cc-24fbb1bfcebe'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Acquiring lock "cinder-5d96bbe0-4023-4314-83f5-cf9923802793-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Delete snapshot completed successfully. Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Lock "cinder-5d96bbe0-4023-4314-83f5-cf9923802793-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7c81f4a5-b546-4b1d-be3b-714cd8dd7205 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-b975fd8e-ee3f-4297-8098-d2636c28050b-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Acquiring lock "cinder-quobyte-5d96bbe0-4023-4314-83f5-cf9923802793" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Lock "cinder-quobyte-5d96bbe0-4023-4314-83f5-cf9923802793" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[723f3802-6681-43cd-98f9-8ecc3040af1d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:17 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793 Sep 09 16:54:17 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:17 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:17 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793 Sep 09 16:54:17 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:18 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d96bbe0-4023-4314-83f5-cf9923802793" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Lock "cinder-quobyte-5d96bbe0-4023-4314-83f5-cf9923802793" released by "delete_volume" :: held 0.786s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-85cc79c5-6208-4f22-b475-85dc1251b4f6-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Created reservations ['96ca836f-44f5-4261-bcab-8634746a0c39', '023f9276-7438-46b1-82a7-ef946e3379b1', 'c920e3cf-84a6-485f-86b8-1930d1b96b94', 'fbe7535c-4dd7-41b5-b2ca-fbd7065cb8f9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-85cc79c5-6208-4f22-b475-85dc1251b4f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-quobyte-85cc79c5-6208-4f22-b475-85dc1251b4f6" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-85cc79c5-6208-4f22-b475-85dc1251b4f6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Deleting offline snapshot 85cc79c5-6208-4f22-b475-85dc1251b4f6 of volume a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] snapshot_file for this snap is: volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[24914234-78c8-4d99-acef-585cd3077c1b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:18 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:18 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:18 devstack sudo[99045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 Sep 09 16:54:18 devstack sudo[99045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:18 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Deleted volume successfully. Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b7a5bb2-7d0d-4153-9bb5-94341c0d4d22 tempest-VolumesTestJSON-300154242 None] Lock "cinder-5d96bbe0-4023-4314-83f5-cf9923802793-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:18 devstack sudo[99045]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6" returned: 0 in 0.451s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9a6e200-6995-47a2-b061-ade811c93508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec150c9-0518-4755-b559-08898baae6e0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:18 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 Sep 09 16:54:18 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:19 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508" returned: 0 in 0.410s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:19 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 Sep 09 16:54:19 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:19 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:19 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6 Sep 09 16:54:19 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:20 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508.85cc79c5-6208-4f22-b475-85dc1251b4f6" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-85cc79c5-6208-4f22-b475-85dc1251b4f6" released by "_delete_snapshot" :: held 1.805s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" released by "delete_snapshot" :: held 1.840s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Created reservations ['e3f43c89-a93d-4efc-bf7d-fcf8015668ca', '808adb54-4e4c-48a2-ad26-d9ab8a31a491', '41a7667b-16dd-4fe0-8809-0a63b69f6f4f', '1e2e9e36-4c85-422d-beb5-564f50654536'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Delete snapshot completed successfully. Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93c14df9-5c18-4922-b8a5-1a0ab0264f10 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-85cc79c5-6208-4f22-b475-85dc1251b4f6-delete_snapshot" released by "delete_snapshot" :: held 2.036s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-a9a6e200-6995-47a2-b061-ade811c93508-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-a9a6e200-6995-47a2-b061-ade811c93508-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef51748f-b21c-484a-89b3-6bb20db303a2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:20 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 Sep 09 16:54:20 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Flow 'volume_create_manager' (ebe8f98d-05ca-4bd9-9d15-1144434d626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768b9365-4181-4b8f-b739-83c3b3607181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (768b9365-4181-4b8f-b739-83c3b3607181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1682127781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea14781c-248c-4267-a69b-0691871eac23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6ff544dd74fcb88c928183d2fd0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:21Z,use_quota=True,user_id='f28ef704f0864276bf5bd375fae9ba24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808e3892-595c-4d27-93fe-430b223aea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808e3892-595c-4d27-93fe-430b223aea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1460b8-1278-44b0-86c4-2425b9fd3cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c1460b8-1278-44b0-86c4-2425b9fd3cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea14781c-248c-4267-a69b-0691871eac23', 'volume_name': 'volume-ea14781c-248c-4267-a69b-0691871eac23', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bb2751-94c5-4a6a-a2dc-a876bfd94678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67bb2751-94c5-4a6a-a2dc-a876bfd94678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffbcb52-93fd-482a-bc11-cd571f4984e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Volume ea14781c-248c-4267-a69b-0691871eac23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea14781c-248c-4267-a69b-0691871eac23', 'volume_size': 1} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1682127781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea14781c-248c-4267-a69b-0691871eac23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6ff544dd74fcb88c928183d2fd0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:21Z,use_quota=True,user_id='f28ef704f0864276bf5bd375fae9ba24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Creating volume ea14781c-248c-4267-a69b-0691871eac23 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:21 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:21 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 1073741824 Sep 09 16:54:21 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:21 devstack sudo[99075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508 Sep 09 16:54:21 devstack sudo[99075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:21 devstack sudo[99075]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a9a6e200-6995-47a2-b061-ade811c93508" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-quobyte-a9a6e200-6995-47a2-b061-ade811c93508" released by "delete_volume" :: held 0.865s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Created reservations ['8bed71ab-e218-4d3c-9e92-a8b463373b0c', 'b38cb496-63f2-4955-985b-3dfa9340074d', 'd8cb08a9-6abf-4fe9-87e1-5ce2d9c35edc', 'fd469b94-d0ae-459a-8811-85adede096d0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:21 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:21 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:21 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 1073741824" returned: 0 in 0.605s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:21 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 Sep 09 16:54:21 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:22 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Deleted volume successfully. Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8e0b6c8a-4132-4546-8729-30de2045eff5 tempest-VolumesSnapshotListTestJSON-44111945 None] Lock "cinder-a9a6e200-6995-47a2-b061-ade811c93508-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:22 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffbcb52-93fd-482a-bc11-cd571f4984e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea14781c-248c-4267-a69b-0691871eac23', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cc637a-a37c-4949-8e82-097ee16e0461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Volume volume-ea14781c-248c-4267-a69b-0691871eac23 (ea14781c-248c-4267-a69b-0691871eac23): created successfully Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74cc637a-a37c-4949-8e82-097ee16e0461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Flow 'volume_create_manager' (ebe8f98d-05ca-4bd9-9d15-1144434d626e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dae648e7-82a0-483e-ac67-1f8337718600 tempest-VolumesCloneTest-2950879 None] Created volume successfully. Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Flow 'volume_create_manager' (fa19928a-87b0-43ee-915d-7ef0573c3ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60bf94d-df16-41dc-9112-1f19943842e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60bf94d-df16-41dc-9112-1f19943842e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-9169447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711f4716-7c4b-4e4f-8ac5-ae93a7120276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1ce10017fa477eab7f23210414d197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:23Z,use_quota=True,user_id='d51d0bc766084296a957a7c50a3534d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91bc974-8161-43cd-bc42-12450632d52d),volume_type_id=b91bc974-8161-43cd-bc42-12450632d52d)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c4eef4-4c4b-408b-8f48-b6a4c8b18bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75c4eef4-4c4b-408b-8f48-b6a4c8b18bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7473cbe6-f489-4fe6-a737-bd76ad0ef863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7473cbe6-f489-4fe6-a737-bd76ad0ef863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711f4716-7c4b-4e4f-8ac5-ae93a7120276', 'volume_name': 'volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebe8463-fe5b-4c52-93eb-4971135765fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cebe8463-fe5b-4c52-93eb-4971135765fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8baa6758-f523-43f7-93b6-58f2d9ed6b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Volume 711f4716-7c4b-4e4f-8ac5-ae93a7120276: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276', 'volume_size': 1} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-9169447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711f4716-7c4b-4e4f-8ac5-ae93a7120276,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1ce10017fa477eab7f23210414d197',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:23Z,use_quota=True,user_id='d51d0bc766084296a957a7c50a3534d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b91bc974-8161-43cd-bc42-12450632d52d),volume_type_id=b91bc974-8161-43cd-bc42-12450632d52d)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Creating volume 711f4716-7c4b-4e4f-8ac5-ae93a7120276 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:22 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:23 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276 1073741824 Sep 09 16:54:23 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:23 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276 1073741824" returned: 0 in 0.809s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:23 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276 Sep 09 16:54:23 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Flow 'volume_create_manager' (f16f56e4-be81-4835-b6d4-ca5e9f190f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669f0a74-3b68-45a5-9d06-bfc7e905d7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (669f0a74-3b68-45a5-9d06-bfc7e905d7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-822796846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87654932-3930-477a-b6c1-3f0e9dd1e80a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50c6ff544dd74fcb88c928183d2fd0ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=ea14781c-248c-4267-a69b-0691871eac23,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:24Z,use_quota=True,user_id='f28ef704f0864276bf5bd375fae9ba24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7d87fd-9f1b-4845-b86c-58a1543d3236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a7d87fd-9f1b-4845-b86c-58a1543d3236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2cac57-3e0f-412c-9f86-a53005f6db16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2cac57-3e0f-412c-9f86-a53005f6db16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '87654932-3930-477a-b6c1-3f0e9dd1e80a', 'volume_name': 'volume-87654932-3930-477a-b6c1-3f0e9dd1e80a', 'volume_size': 2, 'source_volid': 'ea14781c-248c-4267-a69b-0691871eac23', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4387b7e3-f9e5-4fff-adda-f347d3d02567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4387b7e3-f9e5-4fff-adda-f347d3d02567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8267f305-4cfb-49f6-a95e-9e947a2a0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Volume 87654932-3930-477a-b6c1-3f0e9dd1e80a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-87654932-3930-477a-b6c1-3f0e9dd1e80a', 'volume_size': 2, 'source_volid': 'ea14781c-248c-4267-a69b-0691871eac23', 'source_volstatus': 'available'} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:24 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.057s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Cloning volume ea14781c-248c-4267-a69b-0691871eac23 to volume 87654932-3930-477a-b6c1-3f0e9dd1e80a Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8baa6758-f523-43f7-93b6-58f2d9ed6b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef35b05c-c5ba-4897-9d4a-4b32c0de26ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Volume volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276 (711f4716-7c4b-4e4f-8ac5-ae93a7120276): created successfully Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef35b05c-c5ba-4897-9d4a-4b32c0de26ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Flow 'volume_create_manager' (fa19928a-87b0-43ee-915d-7ef0573c3ae7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Creating offline snapshot 79a92d42-6de5-4a50-93d9-07a518741ec2 of volume ea14781c-248c-4267-a69b-0691871eac23 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:54:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-251a410b-e06c-4bfc-9780-50908c30c4ef tempest-VolumeTypesAccessTest-1149962408 None] Created volume successfully. Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[029656b5-d1b1-4254-a6b1-da7abd982905]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:24 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 Sep 09 16:54:24 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:24 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23" returned: 0 in 0.458s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:24 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 1G Sep 09 16:54:24 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2472603f-5125-4dc0-bbd2-41ef41760cd1 tempest-GroupSnapshotsV319Test-1121026555 None] Group tempest-GroupSnapshotsV319Test-Group-417398397: creating Sep 09 16:54:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2472603f-5125-4dc0-bbd2-41ef41760cd1 tempest-GroupSnapshotsV319Test-1121026555 None] Group tempest-GroupSnapshotsV319Test-Group-417398397: created successfully Sep 09 16:54:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2472603f-5125-4dc0-bbd2-41ef41760cd1 tempest-GroupSnapshotsV319Test-1121026555 None] Create group completed successfully. Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Acquiring lock "cinder-711f4716-7c4b-4e4f-8ac5-ae93a7120276-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Lock "cinder-711f4716-7c4b-4e4f-8ac5-ae93a7120276-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Acquiring lock "cinder-quobyte-711f4716-7c4b-4e4f-8ac5-ae93a7120276" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Lock "cinder-quobyte-711f4716-7c4b-4e4f-8ac5-ae93a7120276" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d69c5a-45a0-4e33-8378-f34645a41cad]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:25 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 1G" returned: 0 in 0.527s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea14781c-248c-4267-a69b-0691871eac23 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:25 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276 Sep 09 16:54:25 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:25 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea14781c-248c-4267-a69b-0691871eac23 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 Sep 09 16:54:25 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:25 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:25 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea14781c-248c-4267-a69b-0691871eac23 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2" returned: 0 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:25 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 is being set with open permissions: ugo+rw Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:25 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276 Sep 09 16:54:25 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:25 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 Sep 09 16:54:25 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:25 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:25 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711f4716-7c4b-4e4f-8ac5-ae93a7120276" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Lock "cinder-quobyte-711f4716-7c4b-4e4f-8ac5-ae93a7120276" released by "delete_volume" :: held 0.770s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:25 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.info Sep 09 16:54:25 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:25 devstack cinder-volume[87498]: WARNING cinder.quota [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-579844491 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-579844491, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:54:25 devstack cinder-volume[87498]: WARNING cinder.quota [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-579844491 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-579844491, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Created reservations ['c34ab11c-1304-49db-9891-96908482e29e', '43c4ae7b-e545-457f-8f3f-116917d78abd', '406853a2-f20c-4e26-9a00-4bba07a8f1fc', 'f7b422b5-d9f0-4f68-9932-bf626fe36584'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:26 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:26 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:26 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.info" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:26 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.info is being set with open permissions: ugo+rw Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:26 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.info Sep 09 16:54:26 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:26 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Deleted volume successfully. Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-447ea2aa-4b8c-473d-a322-5db36d883065 tempest-VolumeTypesAccessTest-1149962408 None] Lock "cinder-711f4716-7c4b-4e4f-8ac5-ae93a7120276-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:26 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.info" returned: 0 in 0.417s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Acquiring lock "cinder-quobyte-87654932-3930-477a-b6c1-3f0e9dd1e80a" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Flow 'volume_create_manager' (0105b5d0-6c89-40d4-85ab-b78247c6997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4598a6-1005-48de-a1a7-2eec69be2a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Lock "cinder-quobyte-87654932-3930-477a-b6c1-3f0e9dd1e80a" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] snapshot: 79a92d42-6de5-4a50-93d9-07a518741ec2, volume: 87654932-3930-477a-b6c1-3f0e9dd1e80a, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a4598a6-1005-48de-a1a7-2eec69be2a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1805427699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=467d5d1a-a5f5-46c7-8ced-15da4dc5b01c,host='devstack@QuobyteHD#QuobyteHD',id=0f3ba424-c49c-4b48-8f9a-a6826d9c18da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69da6131ce5b4c3f86de8e0d4e7f1755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:27Z,use_quota=True,user_id='4641a0d5c4744819be021c7d2be58ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e4df950-6024-4ada-8695-0efe3bac3531),volume_type_id=2e4df950-6024-4ada-8695-0efe3bac3531)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27fac0d-52d1-43de-8575-59a40f1c78e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27fac0d-52d1-43de-8575-59a40f1c78e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89b7104-b86d-4119-b79a-8451ce64a275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d89b7104-b86d-4119-b79a-8451ce64a275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f3ba424-c49c-4b48-8f9a-a6826d9c18da', 'volume_name': 'volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9d14a1-c905-4e39-9708-92edb090563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef9d14a1-c905-4e39-9708-92edb090563f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4e0954-53ff-4d1e-9eac-93ee0c8af1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Volume 0f3ba424-c49c-4b48-8f9a-a6826d9c18da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da', 'volume_size': 1} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c319784-e9d4-4e58-adf7-4d821a73c60c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:26 devstack sudo[99170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 Sep 09 16:54:26 devstack sudo[99170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:27 devstack sudo[99170]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea14781c-248c-4267-a69b-0691871eac23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Flow 'volume_create_manager' (18b71acb-c932-4cc8-b0ac-05747338a0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2cabb-9e2c-4086-bbf9-f940d7e9eb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8feb00-365d-47b4-aaec-19687af8946e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ae2cabb-9e2c-4086-bbf9-f940d7e9eb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1686386164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f984f0-d404-4e16-9726-2ced4bb1465d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb5abd73daae4b32a9793af6689f0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:27Z,use_quota=True,user_id='d09a7c80b9b94796a916f52c00776f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f860da-969f-4499-aea2-f97838ef94c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3f860da-969f-4499-aea2-f97838ef94c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffc2637-ddf0-4a10-8e33-b2e1dade45b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ffc2637-ddf0-4a10-8e33-b2e1dade45b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f984f0-d404-4e16-9726-2ced4bb1465d', 'volume_name': 'volume-92f984f0-d404-4e16-9726-2ced4bb1465d', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ace4e55-f56c-4511-9383-e39e4cc21426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ace4e55-f56c-4511-9383-e39e4cc21426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29ac8de-5dd4-4257-a953-8a4d1beea830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Volume 92f984f0-d404-4e16-9726-2ced4bb1465d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f984f0-d404-4e16-9726-2ced4bb1465d', 'volume_size': 2} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:27 devstack sudo[99176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 Sep 09 16:54:27 devstack sudo[99176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:27 devstack sudo[99176]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23" returned: 0 in 0.367s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 16:54:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:27 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a Sep 09 16:54:27 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:32 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a" returned: 0 in 4.926s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:54:32 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Converted 1024.00 MB image at 207.81 MB/s Sep 09 16:54:32 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a is being set with open permissions: ugo+rw Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:32 devstack sudo[99194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a Sep 09 16:54:32 devstack sudo[99194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:32 devstack sudo[99194]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Lock "cinder-quobyte-87654932-3930-477a-b6c1-3f0e9dd1e80a" released by "_copy_volume_from_snapshot" :: held 6.146s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Acquiring lock "cinder-quobyte-79a92d42-6de5-4a50-93d9-07a518741ec2" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Lock "cinder-quobyte-79a92d42-6de5-4a50-93d9-07a518741ec2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Deleting offline snapshot 79a92d42-6de5-4a50-93d9-07a518741ec2 of volume ea14781c-248c-4267-a69b-0691871eac23 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] snapshot_file for this snap is: volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bff6df-1629-4360-b2f0-6ee6ef26495a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:33 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 Sep 09 16:54:33 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:33 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea14781c-248c-4267-a69b-0691871eac23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de03607-733a-4fdc-9782-a0de9ac4a119]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:33 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 Sep 09 16:54:33 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:33 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23" returned: 0 in 0.563s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:34 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 Sep 09 16:54:34 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:34 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:34 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2 Sep 09 16:54:34 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:34 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23.79a92d42-6de5-4a50-93d9-07a518741ec2" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Lock "cinder-quobyte-79a92d42-6de5-4a50-93d9-07a518741ec2" released by "_delete_snapshot" :: held 1.670s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.438s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.803s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=467d5d1a-a5f5-46c7-8ced-15da4dc5b01c,created_at=2026-09-09T14:54:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1805427699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=467d5d1a-a5f5-46c7-8ced-15da4dc5b01c,host='devstack@QuobyteHD#QuobyteHD',id=0f3ba424-c49c-4b48-8f9a-a6826d9c18da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69da6131ce5b4c3f86de8e0d4e7f1755',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:27Z,use_quota=True,user_id='4641a0d5c4744819be021c7d2be58ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2e4df950-6024-4ada-8695-0efe3bac3531),volume_type_id=2e4df950-6024-4ada-8695-0efe3bac3531)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Creating volume 0f3ba424-c49c-4b48-8f9a-a6826d9c18da {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:34 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8267f305-4cfb-49f6-a95e-9e947a2a0125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87654932-3930-477a-b6c1-3f0e9dd1e80a', 'volume_size': 2, 'source_volid': 'ea14781c-248c-4267-a69b-0691871eac23', 'source_volstatus': 'available'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:34 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da 1073741824 Sep 09 16:54:34 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16212ad-fcc7-4724-a290-55746ec5b35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Volume volume-87654932-3930-477a-b6c1-3f0e9dd1e80a (87654932-3930-477a-b6c1-3f0e9dd1e80a): created successfully Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16212ad-fcc7-4724-a290-55746ec5b35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Flow 'volume_create_manager' (f16f56e4-be81-4835-b6d4-ca5e9f190f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-df3ec2c7-7171-4845-92e8-7ab7cfb699c7 tempest-VolumesCloneTest-2950879 None] Created volume successfully. Sep 09 16:54:35 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da 1073741824" returned: 0 in 0.515s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:35 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da Sep 09 16:54:35 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:35 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" returned: 0 in 0.265s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.105s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1686386164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92f984f0-d404-4e16-9726-2ced4bb1465d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb5abd73daae4b32a9793af6689f0593',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:27Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:27Z,use_quota=True,user_id='d09a7c80b9b94796a916f52c00776f24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Creating volume 92f984f0-d404-4e16-9726-2ced4bb1465d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d 2147483648 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4e0954-53ff-4d1e-9eac-93ee0c8af1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:35 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d 2147483648 Sep 09 16:54:35 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d5ad6d-b34f-4509-b60a-f22c1a37797e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Acquiring lock "cinder-87654932-3930-477a-b6c1-3f0e9dd1e80a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Volume volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da (0f3ba424-c49c-4b48-8f9a-a6826d9c18da): created successfully Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d5ad6d-b34f-4509-b60a-f22c1a37797e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Flow 'volume_create_manager' (0105b5d0-6c89-40d4-85ab-b78247c6997e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-090724e8-5da0-424d-b9c9-f08830b76b97 tempest-GroupSnapshotsV319Test-1121026555 None] Created volume successfully. Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Lock "cinder-87654932-3930-477a-b6c1-3f0e9dd1e80a-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Acquiring lock "cinder-quobyte-87654932-3930-477a-b6c1-3f0e9dd1e80a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Lock "cinder-quobyte-87654932-3930-477a-b6c1-3f0e9dd1e80a" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc43527-3940-434f-b365-07468d50517b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:35 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a Sep 09 16:54:35 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:36 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d 2147483648" returned: 0 in 0.605s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:36 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a" returned: 0 in 0.415s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:36 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a Sep 09 16:54:36 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:36 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d Sep 09 16:54:36 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:36 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-87654932-3930-477a-b6c1-3f0e9dd1e80a" returned: 0 in 0.273s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Lock "cinder-quobyte-87654932-3930-477a-b6c1-3f0e9dd1e80a" released by "delete_volume" :: held 0.740s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:36 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29ac8de-5dd4-4257-a953-8a4d1beea830) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f984f0-d404-4e16-9726-2ced4bb1465d', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0257580a-7796-4c45-97df-a660289f19b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Volume volume-92f984f0-d404-4e16-9726-2ced4bb1465d (92f984f0-d404-4e16-9726-2ced4bb1465d): created successfully Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0257580a-7796-4c45-97df-a660289f19b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Flow 'volume_create_manager' (18b71acb-c932-4cc8-b0ac-05747338a0d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bc87166f-3a61-4e55-8031-061855727aa0 tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Created volume successfully. Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Created reservations ['8d06ea81-4334-4bb8-9926-ca93288dd6d1', '3fe42720-aad3-4381-8053-f09555f6bcc7', 'a0e60f48-edee-46e3-b268-be4ac50bc703', '66379c2a-318c-414b-9993-ef6fefefe078'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:36 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:36 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Acquiring lock "cinder-ea14781c-248c-4267-a69b-0691871eac23-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Lock "cinder-ea14781c-248c-4267-a69b-0691871eac23-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:36 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Deleted volume successfully. Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Acquiring lock "cinder-quobyte-ea14781c-248c-4267-a69b-0691871eac23" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0b902146-b956-4b8b-9a0d-94659b318683 tempest-VolumesCloneTest-2950879 None] Lock "cinder-87654932-3930-477a-b6c1-3f0e9dd1e80a-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Lock "cinder-quobyte-ea14781c-248c-4267-a69b-0691871eac23" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9f0f16-eac4-4476-8a9b-e80eb2f6757d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:37 devstack sudo[99247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 Sep 09 16:54:37 devstack sudo[99247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] GroupSnapshot 812bde38-f7f3-4019-b5d9-e4389c39849c: creating. Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Group snapshot 812bde38-f7f3-4019-b5d9-e4389c39849c: creating. {{(pid=87498) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Creating offline snapshot d04f2b79-add3-49ab-a6b3-bc88103392ff of volume 0f3ba424-c49c-4b48-8f9a-a6826d9c18da {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[59920d89-ea25-49ec-84df-709196cb7116]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:37 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da Sep 09 16:54:37 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:37 devstack sudo[99247]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23" returned: 0 in 0.545s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:37 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23 Sep 09 16:54:37 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:37 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" returned: 0 in 0.495s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:37 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff 1G Sep 09 16:54:37 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:37 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ea14781c-248c-4267-a69b-0691871eac23" returned: 0 in 0.302s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Lock "cinder-quobyte-ea14781c-248c-4267-a69b-0691871eac23" released by "delete_volume" :: held 0.922s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Created reservations ['4b213481-02ef-4d59-9650-d20c1aa4ee8f', 'b381276d-b7b1-407d-803a-1f85e50bb790', 'd19943a1-f339-4f02-8662-bbc02a692be5', '0b66c569-3d82-4791-87c7-ee4bfb4b2cf2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:38 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:38 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:38 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff 1G" returned: 0 in 0.520s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:38 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff Sep 09 16:54:38 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:38 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Deleted volume successfully. Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b3be837-15c7-4307-ab1e-18aaa25060fe tempest-VolumesCloneTest-2950879 None] Lock "cinder-ea14781c-248c-4267-a69b-0691871eac23-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:38 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:38 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:38 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff Sep 09 16:54:38 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:38 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:38 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.info Sep 09 16:54:38 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:39 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.info" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:39 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:39 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.info Sep 09 16:54:39 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:39 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.info" returned: 0 in 0.291s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.342s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.811s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Creating offline snapshot a246b102-1566-4c1a-b6c9-6cb019ac1970 of volume 92f984f0-d404-4e16-9726-2ced4bb1465d {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:54:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e0a38-d6e4-477f-9311-b63e901abcfe]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5994b2cb-5f69-4dc8-93db-bc700d98a128 tempest-GroupSnapshotsV319Test-1121026555 None] group_snapshot 812bde38-f7f3-4019-b5d9-e4389c39849c: created successfully Sep 09 16:54:39 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d Sep 09 16:54:39 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:40 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d" returned: 0 in 0.466s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 2G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:40 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 2G Sep 09 16:54:40 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:40 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 2G" returned: 0 in 0.591s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f984f0-d404-4e16-9726-2ced4bb1465d -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:40 devstack sudo[99296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f984f0-d404-4e16-9726-2ced4bb1465d -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 Sep 09 16:54:40 devstack sudo[99296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] group_snapshot 812bde38-f7f3-4019-b5d9-e4389c39849c: deleting Sep 09 16:54:40 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] group_snapshot 812bde38-f7f3-4019-b5d9-e4389c39849c: deleting {{(pid=87498) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 09 16:54:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Acquiring lock "cinder-quobyte-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Lock "cinder-quobyte-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Acquiring lock "cinder-quobyte-d04f2b79-add3-49ab-a6b3-bc88103392ff" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Lock "cinder-quobyte-d04f2b79-add3-49ab-a6b3-bc88103392ff" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Deleting offline snapshot d04f2b79-add3-49ab-a6b3-bc88103392ff of volume 0f3ba424-c49c-4b48-8f9a-a6826d9c18da {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] snapshot_file for this snap is: volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6619bf35-215c-48f9-8e57-17fcf24e233f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:41 devstack sudo[99296]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92f984f0-d404-4e16-9726-2ced4bb1465d -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970" returned: 0 in 0.509s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 is being set with open permissions: ugo+rw Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:41 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 Sep 09 16:54:41 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:41 devstack sudo[99307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff Sep 09 16:54:41 devstack sudo[99307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:41 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:41 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.info Sep 09 16:54:41 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:41 devstack sudo[99307]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff" returned: 0 in 0.508s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b588a799-2467-4de9-84f8-56f9fe558e6b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:41 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da Sep 09 16:54:41 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:41 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.info" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:41 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.info is being set with open permissions: ugo+rw Sep 09 16:54:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:41 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.info Sep 09 16:54:41 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:42 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" returned: 0 in 0.441s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:42 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.info" returned: 0 in 0.295s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:42 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff Sep 09 16:54:42 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e82bd8e1-a161-4b04-88eb-ba96ed8c545f tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Create snapshot completed successfully Sep 09 16:54:42 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:42 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff Sep 09 16:54:42 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:42 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da.d04f2b79-add3-49ab-a6b3-bc88103392ff" returned: 0 in 0.265s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Lock "cinder-quobyte-d04f2b79-add3-49ab-a6b3-bc88103392ff" released by "_delete_snapshot" :: held 1.747s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Lock "cinder-quobyte-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" released by "delete_snapshot" :: held 1.785s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:42 devstack cinder-volume[87498]: WARNING cinder.quota [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1957304009 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1957304009, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:54:42 devstack cinder-volume[87498]: WARNING cinder.quota [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1957304009 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1957304009, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:54:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] Created reservations ['f62a7245-8a24-49cb-bc59-a05fc343581b', 'a183b5cf-8949-4f69-8324-e3549b18712e', '5390d080-6a08-4295-8de0-d6e30ede962a', '171271af-bd01-4403-bc48-bb150cda8d07'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-09106054-9092-422a-8074-48ad305b632c tempest-GroupSnapshotsV319Test-1121026555 None] group_snapshot 812bde38-f7f3-4019-b5d9-e4389c39849c: deleted successfully Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Flow 'volume_create_manager' (fbe11fba-25f0-45bc-9c91-8226c6c4cc8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b320015a-3d06-40e7-a54c-d3c4add7f9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Acquiring lock "cinder-a246b102-1566-4c1a-b6c9-6cb019ac1970-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b320015a-3d06-40e7-a54c-d3c4add7f9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-175391842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d534429-59e3-40ac-963a-b66c7bb6538d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cf19fd4d2a4f4da84902215f1bd634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:43Z,use_quota=True,user_id='f688f7b43e3945a6869f2cb8dd050fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8bfd9f-29da-47d4-9ce1-2e75c9c6f8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8bfd9f-29da-47d4-9ce1-2e75c9c6f8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff928b7e-b4c6-4925-a445-f8346333de75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff928b7e-b4c6-4925-a445-f8346333de75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d534429-59e3-40ac-963a-b66c7bb6538d', 'volume_name': 'volume-6d534429-59e3-40ac-963a-b66c7bb6538d', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fe72c0-2cfe-4661-b82a-5070db1d4fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02fe72c0-2cfe-4661-b82a-5070db1d4fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88660d48-0af5-4c06-8ef4-171aeb6b1886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:43 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Volume 6d534429-59e3-40ac-963a-b66c7bb6538d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d534429-59e3-40ac-963a-b66c7bb6538d', 'volume_size': 2} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-175391842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d534429-59e3-40ac-963a-b66c7bb6538d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cf19fd4d2a4f4da84902215f1bd634',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:43Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:43Z,use_quota=True,user_id='f688f7b43e3945a6869f2cb8dd050fcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Creating volume 6d534429-59e3-40ac-963a-b66c7bb6538d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:43 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d 2147483648 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "cinder-a246b102-1566-4c1a-b6c9-6cb019ac1970-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Acquiring lock "cinder-quobyte-92f984f0-d404-4e16-9726-2ced4bb1465d" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:43 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d 2147483648 Sep 09 16:54:43 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "cinder-quobyte-92f984f0-d404-4e16-9726-2ced4bb1465d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Acquiring lock "cinder-quobyte-a246b102-1566-4c1a-b6c9-6cb019ac1970" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "cinder-quobyte-a246b102-1566-4c1a-b6c9-6cb019ac1970" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Deleting offline snapshot a246b102-1566-4c1a-b6c9-6cb019ac1970 of volume 92f984f0-d404-4e16-9726-2ced4bb1465d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] snapshot_file for this snap is: volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53985fb-f59c-4021-9381-25d53becda0c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:43 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 Sep 09 16:54:43 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Acquiring lock "cinder-quobyte-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Lock "cinder-quobyte-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5997208d-7cb7-4c27-b5ea-ed2500619746]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:43 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970" returned: 0 in 0.508s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92f984f0-d404-4e16-9726-2ced4bb1465d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:54:43 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d 2147483648" returned: 0 in 0.670s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:43 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da Sep 09 16:54:43 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[46df5d81-c013-4a43-ad5f-61392bd043e6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:43 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d Sep 09 16:54:43 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:44 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d Sep 09 16:54:44 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:44 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" returned: 0 in 0.521s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:44 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da Sep 09 16:54:44 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:44 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88660d48-0af5-4c06-8ef4-171aeb6b1886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d534429-59e3-40ac-963a-b66c7bb6538d', 'volume_size': 2}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ebdd35-5513-4264-8793-a53572ab9a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Volume volume-6d534429-59e3-40ac-963a-b66c7bb6538d (6d534429-59e3-40ac-963a-b66c7bb6538d): created successfully Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3ebdd35-5513-4264-8793-a53572ab9a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Flow 'volume_create_manager' (fbe11fba-25f0-45bc-9c91-8226c6c4cc8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f8808107-05c2-4f78-baca-b5085b1c3f50 tempest-VolumesCloneNegativeTest-952965166 None] Created volume successfully. Sep 09 16:54:44 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d" returned: 0 in 0.518s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:44 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 Sep 09 16:54:44 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:44 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Lock "cinder-quobyte-0f3ba424-c49c-4b48-8f9a-a6826d9c18da" released by "delete_volume" :: held 0.897s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Created reservations ['06343b21-fd6a-4aaf-b605-9d5bd0c6a2de'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:44 devstack cinder-volume[87498]: WARNING cinder.quota [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1957304009 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1957304009, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Created reservations ['7bd7f437-d9c5-4a72-98b1-0ed35a0885e8', 'a924d672-4b49-4e4c-a8b3-21be9a5fbcdd', '1873bf77-c6b0-47a3-bcea-c91739efb7e3', '3b552691-b9f6-46b6-89f6-ea205038b8e2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:44 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:44 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:44 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:44 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970 Sep 09 16:54:44 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:45 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:45 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:45 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a64b3ad1-cd8b-4d9f-b573-8c1c0fc1b6d5 tempest-GroupSnapshotsV319Test-1121026555 None] Delete group completed successfully. Sep 09 16:54:45 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d.a246b102-1566-4c1a-b6c9-6cb019ac1970" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "cinder-quobyte-a246b102-1566-4c1a-b6c9-6cb019ac1970" released by "_delete_snapshot" :: held 1.999s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "cinder-quobyte-92f984f0-d404-4e16-9726-2ced4bb1465d" released by "delete_snapshot" :: held 2.041s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Created reservations ['21036121-88ff-421c-bc40-fe9d0c3e6a1c', '2674384c-20f8-45ec-855b-05399de6b552', 'b62d9f6f-566c-4da5-8b54-fe9cf381d47e', '353e10b7-d504-416e-b53b-25d01f5acc64'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:45 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Acquiring lock "cinder-6d534429-59e3-40ac-963a-b66c7bb6538d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Lock "cinder-6d534429-59e3-40ac-963a-b66c7bb6538d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Delete snapshot completed successfully. Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-550fef30-188e-4981-86f2-47d6a30d23bb tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "cinder-a246b102-1566-4c1a-b6c9-6cb019ac1970-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Acquiring lock "cinder-quobyte-6d534429-59e3-40ac-963a-b66c7bb6538d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Lock "cinder-quobyte-6d534429-59e3-40ac-963a-b66c7bb6538d" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d11a37a-4be4-4e5c-b669-a81d988f8754]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:45 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d Sep 09 16:54:45 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:46 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d" returned: 0 in 0.389s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:46 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d Sep 09 16:54:46 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:46 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6d534429-59e3-40ac-963a-b66c7bb6538d" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Lock "cinder-quobyte-6d534429-59e3-40ac-963a-b66c7bb6538d" released by "delete_volume" :: held 0.789s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Acquiring lock "cinder-92f984f0-d404-4e16-9726-2ced4bb1465d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "cinder-92f984f0-d404-4e16-9726-2ced4bb1465d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Created reservations ['8d508825-0094-4d8d-baee-c8b5b8224857', '12f034ae-06ce-4045-b403-f812e49d050f', '35d812c8-477b-4aba-9ef8-1844ac309534', '828afbd2-3776-429c-98ee-d93475fcd6b5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Acquiring lock "cinder-quobyte-92f984f0-d404-4e16-9726-2ced4bb1465d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "cinder-quobyte-92f984f0-d404-4e16-9726-2ced4bb1465d" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e37c79-3f66-4381-95f6-fad23a53a047]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:46 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:46 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:46 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d Sep 09 16:54:46 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:47 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.447s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Deleted volume successfully. Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6363c876-a5cc-4018-9e5a-973e776e48fb tempest-VolumesCloneNegativeTest-952965166 None] Lock "cinder-6d534429-59e3-40ac-963a-b66c7bb6538d-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:47 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d" returned: 0 in 0.516s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:47 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d Sep 09 16:54:47 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:47 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-92f984f0-d404-4e16-9726-2ced4bb1465d" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "cinder-quobyte-92f984f0-d404-4e16-9726-2ced4bb1465d" released by "delete_volume" :: held 0.928s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Created reservations ['bc24e24b-e3f1-45af-b987-30dc583efaa0', '2536735c-e3b0-422c-afcb-dd66cc3f3fe5', 'f499552b-670a-4be2-9a60-6d7ad60c69b2', '001ec9e2-41aa-44de-907d-d76323d0c550'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:47 devstack sudo[99403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:54:47 devstack sudo[99403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:48 devstack sudo[99403]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:48 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:54:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Deleted volume successfully. Sep 09 16:54:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ce52aaf8-4484-43f6-82a5-14dd811ccc5e tempest-VolumesSnapshotNegativeTestJSON-605200200 None] Lock "cinder-92f984f0-d404-4e16-9726-2ced4bb1465d-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:54:53 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=169,cinder:INSERT=49,cinder:UPDATE=208,cinder:DELETE=16 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:54:53 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=206,cinder:SELECT=166,cinder:INSERT=52,cinder:DELETE=16 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:54:53 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Flow 'volume_create_manager' (c3addbd7-0ade-4451-8e7d-08a118d564bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63a9aff-0dd1-4518-8b17-ec69960d9883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e63a9aff-0dd1-4518-8b17-ec69960d9883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1557043466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5fb5c5d-afd6-4765-8414-ac9ef1492e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5c13977e6642f08c359acb43a86c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:54Z,use_quota=True,user_id='e2669cd78b9f44f6a66abf46b7514164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed4293b-4ee7-41a1-bff7-4e87c3db7fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed4293b-4ee7-41a1-bff7-4e87c3db7fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f58b06-a783-4040-84d1-090709248d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:53 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f58b06-a783-4040-84d1-090709248d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5fb5c5d-afd6-4765-8414-ac9ef1492e19', 'volume_name': 'volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9667ac6c-aeac-4e80-8bfe-8e50f2e50d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9667ac6c-aeac-4e80-8bfe-8e50f2e50d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605eef80-0e4b-4c39-a84b-1bfd91d18b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Volume d5fb5c5d-afd6-4765-8414-ac9ef1492e19: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Trying to clone d5fb5c5d-afd6-4765-8414-ac9ef1492e19 from image c8a55b28-da06-4b7e-8774-d16bdd532dbb at location (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Flow 'volume_create_manager' (1724624a-9a4b-45df-9d68-f05fd0d23a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89313b36-7a64-4d33-a22d-8a55777f1684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89313b36-7a64-4d33-a22d-8a55777f1684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1540330285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d337f6-51b8-43ea-93fe-88bb8ff74cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18699f6a02ee4804a0a5d5fab2b9895c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:55Z,use_quota=True,user_id='6418f0c363cc4d909bc857e68bfabe68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c465ad-0f45-4ad6-9fe5-7f04c0b54ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6c465ad-0f45-4ad6-9fe5-7f04c0b54ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde3dcd3-b9e2-4880-8433-66caeb060082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bde3dcd3-b9e2-4880-8433-66caeb060082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78d337f6-51b8-43ea-93fe-88bb8ff74cb4', 'volume_name': 'volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6685913-73be-4a38-94b3-79deabbee7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6685913-73be-4a38-94b3-79deabbee7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373a8b28-2be0-4476-a13c-64f373ab2ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Volume 78d337f6-51b8-43ea-93fe-88bb8ff74cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4', 'volume_size': 1} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1540330285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78d337f6-51b8-43ea-93fe-88bb8ff74cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18699f6a02ee4804a0a5d5fab2b9895c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:55Z,use_quota=True,user_id='6418f0c363cc4d909bc857e68bfabe68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Creating volume 78d337f6-51b8-43ea-93fe-88bb8ff74cb4 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:54 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:54 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4 1073741824 Sep 09 16:54:54 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 16:54:55 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Image download 20.69 MB at 20.69 MB/s Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc225618-56c6-42cb-8840-bd4a4347a332]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:55 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD Sep 09 16:54:55 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:55 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4 1073741824" returned: 0 in 0.604s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:55 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Temporary image c8a55b28-da06-4b7e-8774-d16bdd532dbb is fetched for user e2669cd78b9f44f6a66abf46b7514164. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:55 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4 Sep 09 16:54:55 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e42be7-dede-47b9-9d04-a816d9b8fc16]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:55 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD Sep 09 16:54:55 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:55 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (373a8b28-2be0-4476-a13c-64f373ab2ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8516395b-3521-402f-8558-a208b8ff04e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Volume volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4 (78d337f6-51b8-43ea-93fe-88bb8ff74cb4): created successfully Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8516395b-3521-402f-8558-a208b8ff04e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Flow 'volume_create_manager' (1724624a-9a4b-45df-9d68-f05fd0d23a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1ae1f5b4-c0ef-4caf-b10e-74b6a62ee337 tempest-VolumesListAdminTestJSON-537724487 None] Created volume successfully. Sep 09 16:54:56 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1557043466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5fb5c5d-afd6-4765-8414-ac9ef1492e19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5c13977e6642f08c359acb43a86c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:54Z,use_quota=True,user_id='e2669cd78b9f44f6a66abf46b7514164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Creating volume d5fb5c5d-afd6-4765-8414-ac9ef1492e19 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:56 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:56 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 1073741824 Sep 09 16:54:56 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:56 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 1073741824" returned: 0 in 0.489s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:56 devstack sudo[99436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 Sep 09 16:54:56 devstack sudo[99436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:56 devstack sudo[99436]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Attempting download of c8a55b28-da06-4b7e-8774-d16bdd532dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}])) to volume d5fb5c5d-afd6-4765-8414-ac9ef1492e19. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1197}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[946aed52-9128-4334-b8cf-e57a4120b812]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x__sw9ys {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:57 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x__sw9ys Sep 09 16:54:57 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:54:57 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Flow 'volume_create_manager' (b7219ffa-b9bb-4f71-a694-bd49cfa2b9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a75c6a-825b-40ca-89ac-ec591bf9deef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x__sw9ys" returned: 0 in 0.554s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x__sw9ys {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2a75c6a-825b-40ca-89ac-ec591bf9deef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-798265849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25815286-a976-428a-9a33-58bd65c87a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18699f6a02ee4804a0a5d5fab2b9895c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:58Z,use_quota=True,user_id='6418f0c363cc4d909bc857e68bfabe68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7224659-f3a1-4a74-8462-8be0e838fae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7224659-f3a1-4a74-8462-8be0e838fae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be29b92-e024-4d50-a7a2-76f29cd689b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4be29b92-e024-4d50-a7a2-76f29cd689b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25815286-a976-428a-9a33-58bd65c87a25', 'volume_name': 'volume-25815286-a976-428a-9a33-58bd65c87a25', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2e6ad6-f08c-4941-8bae-7491e52da54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a2e6ad6-f08c-4941-8bae-7491e52da54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16435c6-96b6-4e93-bfd3-d4a1569491b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Volume 25815286-a976-428a-9a33-58bd65c87a25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25815286-a976-428a-9a33-58bd65c87a25', 'volume_size': 1} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-798265849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25815286-a976-428a-9a33-58bd65c87a25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18699f6a02ee4804a0a5d5fab2b9895c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:54:58Z,use_quota=True,user_id='6418f0c363cc4d909bc857e68bfabe68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Creating volume 25815286-a976-428a-9a33-58bd65c87a25 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:54:57 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:54:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:57 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25 1073741824 Sep 09 16:54:57 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:57 devstack sudo[99444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x__sw9ys Sep 09 16:54:57 devstack sudo[99444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:58 devstack sudo[99444]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x__sw9ys" returned: 1 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x__sw9ys' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf94c2b-b53c-489a-9cc7-b771e4e4febe]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:58 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD Sep 09 16:54:58 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:58 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25 1073741824" returned: 0 in 0.645s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:58 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] c8a55b28-da06-4b7e-8774-d16bdd532dbb was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 16:54:58 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25 Sep 09 16:54:58 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:54:58 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 Sep 09 16:54:58 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:54:58 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e16435c6-96b6-4e93-bfd3-d4a1569491b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25815286-a976-428a-9a33-58bd65c87a25', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c513b2c-babe-4d56-9d30-fddf6bdb5dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:54:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Volume volume-25815286-a976-428a-9a33-58bd65c87a25 (25815286-a976-428a-9a33-58bd65c87a25): created successfully Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c513b2c-babe-4d56-9d30-fddf6bdb5dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:54:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Flow 'volume_create_manager' (b7219ffa-b9bb-4f71-a694-bd49cfa2b9e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:54:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8314b5e9-2700-4f16-85d5-9eadd6ae467e tempest-VolumesListAdminTestJSON-537724487 None] Created volume successfully. Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Flow 'volume_create_manager' (d1a3dfb3-3546-442b-9146-9107426646da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa74c03-2901-4d18-ac5a-7279dc6a27ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfa74c03-2901-4d18-ac5a-7279dc6a27ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-678646518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9d2a3a-189b-4513-96f0-c09e2ba2bd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18699f6a02ee4804a0a5d5fab2b9895c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:01Z,use_quota=True,user_id='6418f0c363cc4d909bc857e68bfabe68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0f8463-a9cc-415c-984e-7b4eb7ba8ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c0f8463-a9cc-415c-984e-7b4eb7ba8ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c3bc73-2460-439e-a6a4-f12d3a218859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5c3bc73-2460-439e-a6a4-f12d3a218859) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb9d2a3a-189b-4513-96f0-c09e2ba2bd70', 'volume_name': 'volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac36898-e5e7-4431-973a-6ca8b1aaf5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ac36898-e5e7-4431-973a-6ca8b1aaf5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3112c3c0-dc4d-4efb-8224-3f899029e9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Volume eb9d2a3a-189b-4513-96f0-c09e2ba2bd70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70', 'volume_size': 1} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-678646518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb9d2a3a-189b-4513-96f0-c09e2ba2bd70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18699f6a02ee4804a0a5d5fab2b9895c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:01Z,use_quota=True,user_id='6418f0c363cc4d909bc857e68bfabe68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Creating volume eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:55:00 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:00 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 1073741824 Sep 09 16:55:00 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:00 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19" returned: 0 in 2.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_x1wx6fh5devstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:55:00 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Converted 112.00 MB image at 45.89 MB/s Sep 09 16:55:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:00 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 1G Sep 09 16:55:00 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:01 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 1073741824" returned: 0 in 0.540s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:01 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 Sep 09 16:55:01 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:01 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 1G" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Downloaded image c8a55b28-da06-4b7e-8774-d16bdd532dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}])) to volume d5fb5c5d-afd6-4765-8414-ac9ef1492e19 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1242}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Temporary image c8a55b28-da06-4b7e-8774-d16bdd532dbb for user e2669cd78b9f44f6a66abf46b7514164 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Marking volume d5fb5c5d-afd6-4765-8414-ac9ef1492e19 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1146}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Copying metadata from image c8a55b28-da06-4b7e-8774-d16bdd532dbb to d5fb5c5d-afd6-4765-8414-ac9ef1492e19. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Creating volume glance metadata for volume d5fb5c5d-afd6-4765-8414-ac9ef1492e19 backed by image c8a55b28-da06-4b7e-8774-d16bdd532dbb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605eef80-0e4b-4c39-a84b-1bfd91d18b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c60e82-a9c8-4b0e-a581-6adaef4beb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Volume volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 (d5fb5c5d-afd6-4765-8414-ac9ef1492e19): created successfully Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68c60e82-a9c8-4b0e-a581-6adaef4beb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Flow 'volume_create_manager' (c3addbd7-0ade-4451-8e7d-08a118d564bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fb6b3cef-b8ad-4d11-99be-6cb9599e1f79 tempest-VolumesExtendTest-996616966 None] Created volume successfully. Sep 09 16:55:01 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3112c3c0-dc4d-4efb-8224-3f899029e9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe82308d-d36c-4771-a455-7102e3df1d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Volume volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 (eb9d2a3a-189b-4513-96f0-c09e2ba2bd70): created successfully Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe82308d-d36c-4771-a455-7102e3df1d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Flow 'volume_create_manager' (d1a3dfb3-3546-442b-9146-9107426646da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-393f125b-6270-4eb6-8719-8e02c6940bd9 tempest-VolumesListAdminTestJSON-537724487 None] Created volume successfully. Sep 09 16:55:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c6678648-723f-464a-b89d-37aa6a56ff4d tempest-GroupsV314Test-1619718178 None] Group tempest-GroupsV314Test-Group-1186810956: creating Sep 09 16:55:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c6678648-723f-464a-b89d-37aa6a56ff4d tempest-GroupsV314Test-1619718178 None] Group tempest-GroupsV314Test-Group-1186810956: created successfully Sep 09 16:55:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c4aaecf6-39ed-483c-aead-566eb58a5b6b tempest-VolumesExtendTest-996616966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c4aaecf6-39ed-483c-aead-566eb58a5b6b tempest-VolumesExtendTest-996616966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c6678648-723f-464a-b89d-37aa6a56ff4d tempest-GroupsV314Test-1619718178 None] Create group completed successfully. Sep 09 16:55:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab76d857-b1c6-4fcb-9c99-69e28d5f2ce7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c4aaecf6-39ed-483c-aead-566eb58a5b6b tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:03 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 Sep 09 16:55:03 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:03 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c4aaecf6-39ed-483c-aead-566eb58a5b6b tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19" returned: 0 in 0.511s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c4aaecf6-39ed-483c-aead-566eb58a5b6b tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 2G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c4aaecf6-39ed-483c-aead-566eb58a5b6b tempest-VolumesExtendTest-996616966 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 2G" returned: 0 in 0.166s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c4aaecf6-39ed-483c-aead-566eb58a5b6b tempest-VolumesExtendTest-996616966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.704s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c4aaecf6-39ed-483c-aead-566eb58a5b6b tempest-VolumesExtendTest-996616966 None] Extend volume completed successfully. Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Flow 'volume_create_manager' (2b3426fd-a36d-455b-ba67-07696948247b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a3ba12-dc9f-409b-ae2d-e0074dd6c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52a3ba12-dc9f-409b-ae2d-e0074dd6c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a17b10-9362-4159-a4c0-bc89edc2b7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='accf2b819fe5477da20b8e53f3bc5fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:04Z,use_quota=True,user_id='dbd18bab41ce442899e69cadb82c6c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80425842-eef9-443f-8771-0d0f083942dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80425842-eef9-443f-8771-0d0f083942dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3843b44-4e75-4d6a-8f0c-4d3ba5a65e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3843b44-4e75-4d6a-8f0c-4d3ba5a65e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a17b10-9362-4159-a4c0-bc89edc2b7d1', 'volume_name': 'volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27107280-8335-4156-9549-a6763380b6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27107280-8335-4156-9549-a6763380b6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e668b221-6192-4837-a261-38ec653f234e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Volume f1a17b10-9362-4159-a4c0-bc89edc2b7d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1', 'volume_size': 1} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a17b10-9362-4159-a4c0-bc89edc2b7d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='accf2b819fe5477da20b8e53f3bc5fc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:04Z,use_quota=True,user_id='dbd18bab41ce442899e69cadb82c6c79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Creating volume f1a17b10-9362-4159-a4c0-bc89edc2b7d1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:55:03 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:55:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:03 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1 1073741824 Sep 09 16:55:03 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:04 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1 1073741824" returned: 0 in 0.666s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Acquiring lock "cinder-d5fb5c5d-afd6-4765-8414-ac9ef1492e19-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Lock "cinder-d5fb5c5d-afd6-4765-8414-ac9ef1492e19-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:04 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1 Sep 09 16:55:04 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Flow 'volume_create_manager' (74db688d-8c04-4e7c-a649-0f6d57afc812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9b9222-27ad-445a-991b-c9ecd0c40f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Acquiring lock "cinder-quobyte-d5fb5c5d-afd6-4765-8414-ac9ef1492e19" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee9b9222-27ad-445a-991b-c9ecd0c40f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-963501092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58786323-a2a0-45d0-8241-60a2f3eb756d,host='devstack@QuobyteHD#QuobyteHD',id=bf2bad3a-7c5c-41cf-92b3-4f5865408e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8be873bbbbe4a65bf1a4cd6e01c7e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:05Z,use_quota=True,user_id='f089c5dc5de54ab6afab1df21d5398f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dbf8cb7-1a17-4e4d-b395-1cc933f3b30b),volume_type_id=5dbf8cb7-1a17-4e4d-b395-1cc933f3b30b)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad171056-c800-4f84-9972-9430e82344c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad171056-c800-4f84-9972-9430e82344c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1afbd0a-9c7d-4ef3-ad15-8c75bf92c65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1afbd0a-9c7d-4ef3-ad15-8c75bf92c65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf2bad3a-7c5c-41cf-92b3-4f5865408e66', 'volume_name': 'volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8e9992-7c67-42db-8a64-72084e571280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf8e9992-7c67-42db-8a64-72084e571280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ef1333-72f8-4781-95ad-41b9e3936398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Volume bf2bad3a-7c5c-41cf-92b3-4f5865408e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66', 'volume_size': 1} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Lock "cinder-quobyte-d5fb5c5d-afd6-4765-8414-ac9ef1492e19" acquired by "delete_volume" :: waited 0.058s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed3648c-ab5f-4658-ae41-e395cbff4464]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:04 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.124s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=58786323-a2a0-45d0-8241-60a2f3eb756d,created_at=2026-09-09T14:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-963501092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58786323-a2a0-45d0-8241-60a2f3eb756d,host='devstack@QuobyteHD#QuobyteHD',id=bf2bad3a-7c5c-41cf-92b3-4f5865408e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8be873bbbbe4a65bf1a4cd6e01c7e39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:05Z,use_quota=True,user_id='f089c5dc5de54ab6afab1df21d5398f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dbf8cb7-1a17-4e4d-b395-1cc933f3b30b),volume_type_id=5dbf8cb7-1a17-4e4d-b395-1cc933f3b30b)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Creating volume bf2bad3a-7c5c-41cf-92b3-4f5865408e66 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:55:04 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:04 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 Sep 09 16:55:04 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e668b221-6192-4837-a261-38ec653f234e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5417518f-cd11-48cd-b7ab-cdd2b88961b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:04 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 1073741824 Sep 09 16:55:04 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Volume volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1 (f1a17b10-9362-4159-a4c0-bc89edc2b7d1): created successfully Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5417518f-cd11-48cd-b7ab-cdd2b88961b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Flow 'volume_create_manager' (2b3426fd-a36d-455b-ba67-07696948247b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6f28ea05-bc87-46ee-ae52-0cd9b81df454 tempest-VolumesListAdminTestJSON-1086782801 None] Created volume successfully. Sep 09 16:55:05 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:05 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19 Sep 09 16:55:05 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:05 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 1073741824" returned: 0 in 0.547s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:05 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d5fb5c5d-afd6-4765-8414-ac9ef1492e19" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:05 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 Sep 09 16:55:05 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Lock "cinder-quobyte-d5fb5c5d-afd6-4765-8414-ac9ef1492e19" released by "delete_volume" :: held 0.760s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Created reservations ['fea1ed15-9ec3-4618-b543-1e53d88202cb', 'bdc4ac4c-29e6-4cd7-9366-b839944aa709', 'b87e082c-2f0f-4082-8853-97ae65e66584', '17175c47-09de-4934-996f-5207836040a4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:05 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:05 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:05 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ef1333-72f8-4781-95ad-41b9e3936398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c612b073-005e-4ab3-895e-2a8858e2d5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Volume volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 (bf2bad3a-7c5c-41cf-92b3-4f5865408e66): created successfully Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c612b073-005e-4ab3-895e-2a8858e2d5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Flow 'volume_create_manager' (74db688d-8c04-4e7c-a649-0f6d57afc812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9d74e376-661c-4d73-9456-73380fc7b537 tempest-GroupsV314Test-1619718178 None] Created volume successfully. Sep 09 16:55:06 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.328s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Deleted volume successfully. Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2010314a-f576-43ae-8a4e-c2b9dbe9a8fe tempest-VolumesExtendTest-996616966 None] Lock "cinder-d5fb5c5d-afd6-4765-8414-ac9ef1492e19-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Acquiring lock "cinder-f1a17b10-9362-4159-a4c0-bc89edc2b7d1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Lock "cinder-f1a17b10-9362-4159-a4c0-bc89edc2b7d1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Acquiring lock "cinder-quobyte-f1a17b10-9362-4159-a4c0-bc89edc2b7d1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Lock "cinder-quobyte-f1a17b10-9362-4159-a4c0-bc89edc2b7d1" acquired by "delete_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35dea6a-67a6-468d-9a9a-59c5723b5f51]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Flow 'volume_create_manager' (c9fbe033-771d-4dd7-af5d-064ab67be79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211af0f8-08fa-4830-9937-f1b58426b447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211af0f8-08fa-4830-9937-f1b58426b447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-562822278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ed5540-e6ed-45ca-8ae6-260f314e3527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5c13977e6642f08c359acb43a86c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:06Z,use_quota=True,user_id='e2669cd78b9f44f6a66abf46b7514164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcb17a1-1eda-4de2-9a3e-bbd732644dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fcb17a1-1eda-4de2-9a3e-bbd732644dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480e2d39-9fb0-49ef-93a8-f75a78445e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480e2d39-9fb0-49ef-93a8-f75a78445e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ed5540-e6ed-45ca-8ae6-260f314e3527', 'volume_name': 'volume-30ed5540-e6ed-45ca-8ae6-260f314e3527', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecd71a4-b31f-404a-aad7-cb7e316cfed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cecd71a4-b31f-404a-aad7-cb7e316cfed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a245e042-d78d-49ab-a80f-cc9ec1229f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Volume 30ed5540-e6ed-45ca-8ae6-260f314e3527: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ed5540-e6ed-45ca-8ae6-260f314e3527', 'volume_size': 1} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-562822278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ed5540-e6ed-45ca-8ae6-260f314e3527,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc5c13977e6642f08c359acb43a86c74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:06Z,use_quota=True,user_id='e2669cd78b9f44f6a66abf46b7514164',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Creating volume 30ed5540-e6ed-45ca-8ae6-260f314e3527 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:06 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1 Sep 09 16:55:06 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:55:06 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "cinder-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:06 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 1073741824 Sep 09 16:55:06 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "cinder-quobyte-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-quobyte-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31bf061-4bb3-4148-8684-93d14806b83e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:06 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 Sep 09 16:55:06 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:06 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1" returned: 0 in 0.594s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:07 devstack sudo[99868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1 Sep 09 16:55:07 devstack sudo[99868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:07 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70" returned: 0 in 0.543s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:07 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 1073741824" returned: 0 in 0.685s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:07 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70 Sep 09 16:55:07 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:07 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 Sep 09 16:55:07 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:07 devstack sudo[99868]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f1a17b10-9362-4159-a4c0-bc89edc2b7d1" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Lock "cinder-quobyte-f1a17b10-9362-4159-a4c0-bc89edc2b7d1" released by "delete_volume" :: held 1.040s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Created reservations ['beb29775-cc99-4434-9093-15601db743a4', 'c57827f5-dbd3-473a-901f-89c09763398e', 'fd265c98-4d45-4d3f-9ed2-1cad16c9ba7d', '734a156f-a19c-4c55-b861-80abf226e1fa'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:07 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:07 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:07 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:07 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70" returned: 0 in 0.480s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a245e042-d78d-49ab-a80f-cc9ec1229f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ed5540-e6ed-45ca-8ae6-260f314e3527', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5473e6-2d8a-4ef3-acb6-0d582e8f37fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-quobyte-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70" released by "delete_volume" :: held 1.092s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Volume volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 (30ed5540-e6ed-45ca-8ae6-260f314e3527): created successfully Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a5473e6-2d8a-4ef3-acb6-0d582e8f37fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Flow 'volume_create_manager' (c9fbe033-771d-4dd7-af5d-064ab67be79e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b8c21eec-e8a3-4b34-a831-b22285e3e712 tempest-VolumesExtendTest-996616966 None] Created volume successfully. Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Created reservations ['68427e3d-a00a-4717-a038-b9e730275a1a', '3d645187-7207-4b5c-8480-dd7a76de6114', '3aac56f5-dbe2-4c83-8b19-18d27b243b6b', 'f2c7ca4a-7df4-474b-a00a-871c94fa0c77'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:07 devstack sudo[99884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:07 devstack sudo[99884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:07 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.355s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Deleted volume successfully. Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c41b3bcf-dd55-4ee1-ade9-d57df2cd215f tempest-VolumesListAdminTestJSON-1086782801 None] Lock "cinder-f1a17b10-9362-4159-a4c0-bc89edc2b7d1-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:08 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Cloning volume bf2bad3a-7c5c-41cf-92b3-4f5865408e66 to volume 2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Creating offline snapshot cb264ead-d341-4439-aa19-766b0219f946 of volume bf2bad3a-7c5c-41cf-92b3-4f5865408e66 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2abad5a-f96c-4c0f-8010-e1c339caf6d1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:08 devstack sudo[99884]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Deleted volume successfully. Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0a5976fb-94f2-426a-a8ef-db0af6eb9244 tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-eb9d2a3a-189b-4513-96f0-c09e2ba2bd70-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:08 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 Sep 09 16:55:08 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:08 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66" returned: 0 in 0.632s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "cinder-25815286-a976-428a-9a33-58bd65c87a25-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:08 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 1G Sep 09 16:55:08 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-25815286-a976-428a-9a33-58bd65c87a25-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "cinder-quobyte-25815286-a976-428a-9a33-58bd65c87a25" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-quobyte-25815286-a976-428a-9a33-58bd65c87a25" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea3ffda-5cf3-413a-83ab-7e0473acdc53]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:09 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25 Sep 09 16:55:09 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:09 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 1G" returned: 0 in 0.525s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:09 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 Sep 09 16:55:09 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:09 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:09 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25 Sep 09 16:55:09 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:09 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:09 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 Sep 09 16:55:09 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:09 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-25815286-a976-428a-9a33-58bd65c87a25" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-quobyte-25815286-a976-428a-9a33-58bd65c87a25" released by "delete_volume" :: held 0.852s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Created reservations ['aa40721e-51cb-438a-ad0b-9c70a6b6866f', '2add3155-2312-45c5-ab68-a46711784e69', '3b891a4b-4fed-488e-ad8e-a5888f28b30a', 'f894e7d4-e46b-4d6a-b9aa-861f5fc4af10'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:10 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946" returned: 0 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:10 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:10 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:10 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.info Sep 09 16:55:10 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:10 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Deleted volume successfully. Sep 09 16:55:10 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.info" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:10 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.info is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e65320f7-6464-421c-9e6e-14facd31327c tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-25815286-a976-428a-9a33-58bd65c87a25-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:10 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.info Sep 09 16:55:10 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:10 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.info" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Acquiring lock "cinder-quobyte-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Lock "cinder-quobyte-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] snapshot: cb264ead-d341-4439-aa19-766b0219f946, volume: 2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0ed91e-7a40-472a-80e5-2c11dc77ffcd]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:10 devstack sudo[99925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 Sep 09 16:55:10 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:11 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946" returned: 0 in 0.442s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "cinder-78d337f6-51b8-43ea-93fe-88bb8ff74cb4-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef1b411-62b4-4ceb-aa3c-4e48f235cf5a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-78d337f6-51b8-43ea-93fe-88bb8ff74cb4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "cinder-quobyte-78d337f6-51b8-43ea-93fe-88bb8ff74cb4" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-quobyte-78d337f6-51b8-43ea-93fe-88bb8ff74cb4" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bed521a-275a-408d-9b66-798f5412ae48]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:11 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 Sep 09 16:55:11 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:11 devstack sudo[99932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4 Sep 09 16:55:11 devstack sudo[99932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:11 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:11 devstack sudo[99939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e Sep 09 16:55:11 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:11 devstack sudo[99932]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:11 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4 Sep 09 16:55:11 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:12 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-78d337f6-51b8-43ea-93fe-88bb8ff74cb4" returned: 0 in 0.303s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-quobyte-78d337f6-51b8-43ea-93fe-88bb8ff74cb4" released by "delete_volume" :: held 0.830s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:12 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Created reservations ['5a2c6391-e719-45a7-ab8d-50bc41459138', '3fe857a2-972e-4bb7-b6f3-1b8dbb6147f0', 'c8cace06-3660-4360-998c-8db57baad6b4', 'b452f877-119b-425d-8a62-61966d384622'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:12 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:12 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:13 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.685s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:13 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Deleted volume successfully. Sep 09 16:55:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0082ba65-93c2-4f73-840c-4dc0c9844616 tempest-VolumesListAdminTestJSON-537724487 None] Lock "cinder-78d337f6-51b8-43ea-93fe-88bb8ff74cb4-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:17 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e" returned: 0 in 5.879s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:17 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:55:17 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Converted 1024.00 MB image at 174.16 MB/s Sep 09 16:55:17 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e is being set with open permissions: ugo+rw: NotImplementedError Sep 09 16:55:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:17 devstack sudo[100050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e Sep 09 16:55:17 devstack sudo[100050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:17 devstack sudo[100050]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Lock "cinder-quobyte-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e" released by "_copy_volume_from_snapshot" :: held 7.208s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Acquiring lock "cinder-quobyte-cb264ead-d341-4439-aa19-766b0219f946" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Lock "cinder-quobyte-cb264ead-d341-4439-aa19-766b0219f946" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Deleting offline snapshot cb264ead-d341-4439-aa19-766b0219f946 of volume bf2bad3a-7c5c-41cf-92b3-4f5865408e66 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] snapshot_file for this snap is: volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2854c0-753a-4a28-9d9d-b626ddb8cfd9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:18 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 Sep 09 16:55:18 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:18 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946" returned: 0 in 0.518s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e62113e-65cf-4739-aa2e-68d287500fa7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:18 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 Sep 09 16:55:18 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:19 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66" returned: 0 in 0.829s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:19 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 Sep 09 16:55:19 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:19 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946" returned: 0 in 0.400s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:19 devstack sudo[100070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946 Sep 09 16:55:19 devstack sudo[100070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:20 devstack sudo[100070]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66.cb264ead-d341-4439-aa19-766b0219f946" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Lock "cinder-quobyte-cb264ead-d341-4439-aa19-766b0219f946" released by "_delete_snapshot" :: held 2.175s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.032s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.427s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Creating offline snapshot 859f0bb3-c377-461c-8c4d-986755a1f85b of volume 30ed5540-e6ed-45ca-8ae6-260f314e3527 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:55:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea5dba2-1c1a-41f7-98b1-6200c0016bb3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a70cacb9-70d6-4cdb-b158-01e0c29fde0a tempest-GroupsV314Test-1619718178 None] Create group from source-group-58786323-a2a0-45d0-8241-60a2f3eb756d completed successfully. Sep 09 16:55:20 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 Sep 09 16:55:20 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:20 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527" returned: 0 in 0.542s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:20 devstack sudo[100078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b 1G Sep 09 16:55:20 devstack sudo[100078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Acquiring lock "cinder-quobyte-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Lock "cinder-quobyte-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:21 devstack sudo[100078]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78799ff-ac1f-4e05-ad3b-c2ea48ad9343]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b 1G" returned: 0 in 0.700s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:21 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b Sep 09 16:55:21 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:21 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e Sep 09 16:55:21 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:21 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:21 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b is being set with open permissions: ugo+rw Sep 09 16:55:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:22 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b Sep 09 16:55:22 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:22 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e" returned: 0 in 0.700s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:22 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e Sep 09 16:55:22 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:22 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:22 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.info Sep 09 16:55:22 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:22 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e" returned: 0 in 0.500s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Lock "cinder-quobyte-2d7b1b2c-0b84-4ed4-bb0d-86aaa6a1265e" released by "delete_volume" :: held 1.289s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:22 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.info" returned: 0 in 0.428s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:22 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.info is being set with open permissions: ugo+rw Sep 09 16:55:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:22 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.info Sep 09 16:55:22 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:22 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Created reservations ['978204fa-e081-4c34-b36a-da4753592dd9'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:22 devstack cinder-volume[87498]: WARNING cinder.quota [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-194168526 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-194168526, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:55:22 devstack cinder-volume[87498]: WARNING cinder.quota [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-194168526 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-194168526, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Created reservations ['a9ae1d85-238b-4d37-9211-aeea4600d9ac', '32a732e4-03ef-46bd-96a1-02d8550326d4', '9df2413e-807d-47c2-9483-138645e6040a', '2a745ffd-2c4f-4ca6-a277-19e173bd475a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:23 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.info" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:23 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:23 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.029s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-db6ce783-9e63-49b0-99cb-123280fbfaec tempest-VolumesExtendTest-996616966 None] Create snapshot completed successfully Sep 09 16:55:23 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2c1c5a03-bb52-4d70-a453-6488eaa7a50f tempest-GroupsV314Test-1619718178 None] Delete group completed successfully. Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-610ec204-2d97-4e54-a03d-86975d1bb05e tempest-VolumesExtendTest-996616966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-610ec204-2d97-4e54-a03d-86975d1bb05e tempest-VolumesExtendTest-996616966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efd3dcc-87c2-44ea-aa7d-634cedefcc24]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-610ec204-2d97-4e54-a03d-86975d1bb05e tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:24 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 Sep 09 16:55:24 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:24 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-610ec204-2d97-4e54-a03d-86975d1bb05e tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527" returned: 0 in 0.558s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-610ec204-2d97-4e54-a03d-86975d1bb05e tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b 2G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Acquiring lock "cinder-quobyte-bf2bad3a-7c5c-41cf-92b3-4f5865408e66" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Lock "cinder-quobyte-bf2bad3a-7c5c-41cf-92b3-4f5865408e66" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc4453df-0923-4977-bc37-09b04a02246a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-610ec204-2d97-4e54-a03d-86975d1bb05e tempest-VolumesExtendTest-996616966 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b 2G" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-610ec204-2d97-4e54-a03d-86975d1bb05e tempest-VolumesExtendTest-996616966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.871s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:24 devstack sudo[100153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 Sep 09 16:55:24 devstack sudo[100153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-610ec204-2d97-4e54-a03d-86975d1bb05e tempest-VolumesExtendTest-996616966 None] Extend volume completed successfully. Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Flow 'volume_create_manager' (1d8edfe2-e675-48e6-865a-a236d369ce42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a42c92-a410-45a8-bf6d-e51db03df623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19a42c92-a410-45a8-bf6d-e51db03df623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1098314991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cc1ebf-2826-4176-8d89-b58fe54f48ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502497cbf45d455c841291572bbc4696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:25Z,use_quota=True,user_id='4eab33ae6b58433dbd0808d7b66c419b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bd8e4d-be87-4e3a-b1d7-1a4e74e793e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3bd8e4d-be87-4e3a-b1d7-1a4e74e793e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e1ee47-97ad-4738-96c6-021d93831043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Acquiring lock "cinder-859f0bb3-c377-461c-8c4d-986755a1f85b-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:25 devstack sudo[100153]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66" returned: 0 in 0.525s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Lock "cinder-859f0bb3-c377-461c-8c4d-986755a1f85b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Acquiring lock "cinder-quobyte-30ed5540-e6ed-45ca-8ae6-260f314e3527" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:25 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66 Sep 09 16:55:25 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Lock "cinder-quobyte-30ed5540-e6ed-45ca-8ae6-260f314e3527" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Acquiring lock "cinder-quobyte-859f0bb3-c377-461c-8c4d-986755a1f85b" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Lock "cinder-quobyte-859f0bb3-c377-461c-8c4d-986755a1f85b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Deleting offline snapshot 859f0bb3-c377-461c-8c4d-986755a1f85b of volume 30ed5540-e6ed-45ca-8ae6-260f314e3527 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] snapshot_file for this snap is: volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[17202776-9209-4a22-b1b5-b3dc87f1bedb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99e1ee47-97ad-4738-96c6-021d93831043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '32cc1ebf-2826-4176-8d89-b58fe54f48ee', 'volume_name': 'volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb0df3e-d77f-4907-814e-22bd494fdb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb0df3e-d77f-4907-814e-22bd494fdb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342c0616-ba9b-41f7-b11c-f182e3dd54c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Volume 32cc1ebf-2826-4176-8d89-b58fe54f48ee: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Trying to clone 32cc1ebf-2826-4176-8d89-b58fe54f48ee from image c8a55b28-da06-4b7e-8774-d16bdd532dbb at location (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 16:55:25 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b Sep 09 16:55:25 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:25 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bf2bad3a-7c5c-41cf-92b3-4f5865408e66" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Lock "cinder-quobyte-bf2bad3a-7c5c-41cf-92b3-4f5865408e66" released by "delete_volume" :: held 0.967s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Created reservations ['79e38d3b-f7a4-43e7-ba9e-91c3439dad9e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:25 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b" returned: 0 in 0.521s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30ed5540-e6ed-45ca-8ae6-260f314e3527(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a18387-47d9-484f-b0f0-8b93e7e35670]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:25 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 16:55:25 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Image download 20.69 MB at 20.69 MB/s Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Created reservations ['78d8e5e8-75d7-4c8a-b0b0-899a3dfa3d3f', 'f71e322c-a0e4-4984-877c-a6f786002e65', 'c73788c4-f9b9-400b-9fb9-29b383c9eccd', 'a29a1899-a0cc-4b8e-85e8-0eb53641ff0c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c0f506-f090-4ee4-8712-e6c4616b810d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:26 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 Sep 09 16:55:26 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:26 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD Sep 09 16:55:26 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:26 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:26 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:26 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:26 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b Sep 09 16:55:26 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:26 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Temporary image c8a55b28-da06-4b7e-8774-d16bdd532dbb is fetched for user 4eab33ae6b58433dbd0808d7b66c419b. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 16:55:26 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f9e0648c-6b62-409e-8c83-1a63a2cb59d6 tempest-GroupsV314Test-1619718178 None] Delete group completed successfully. Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ddc000-877c-47de-bae0-35d97c66a53f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:26 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD Sep 09 16:55:26 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:26 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:26 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b Sep 09 16:55:26 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:26 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1098314991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cc1ebf-2826-4176-8d89-b58fe54f48ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='502497cbf45d455c841291572bbc4696',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:25Z,use_quota=True,user_id='4eab33ae6b58433dbd0808d7b66c419b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Creating volume 32cc1ebf-2826-4176-8d89-b58fe54f48ee {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:55:26 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:55:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:26 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee 1073741824 Sep 09 16:55:26 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:27 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527.859f0bb3-c377-461c-8c4d-986755a1f85b" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Lock "cinder-quobyte-859f0bb3-c377-461c-8c4d-986755a1f85b" released by "_delete_snapshot" :: held 1.899s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Lock "cinder-quobyte-30ed5540-e6ed-45ca-8ae6-260f314e3527" released by "delete_snapshot" :: held 1.927s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Created reservations ['ab813a79-fc5e-484d-a6f1-6178fba916ff', '8b61915d-5475-4f24-ae0b-55ec3e5073b3', '7c8075a4-b6c1-4339-92ac-adf374d283dc', 'f26cf058-b299-4b42-a4bf-6af6c52cfaf4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Delete snapshot completed successfully. Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1a3430f1-d29c-4513-b7ee-46d052985bd6 tempest-VolumesExtendTest-996616966 None] Lock "cinder-859f0bb3-c377-461c-8c4d-986755a1f85b-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Acquiring lock "cinder-30ed5540-e6ed-45ca-8ae6-260f314e3527-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Lock "cinder-30ed5540-e6ed-45ca-8ae6-260f314e3527-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:27 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee 1073741824" returned: 0 in 0.626s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Acquiring lock "cinder-quobyte-30ed5540-e6ed-45ca-8ae6-260f314e3527" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Lock "cinder-quobyte-30ed5540-e6ed-45ca-8ae6-260f314e3527" acquired by "delete_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[daae63f5-14fc-46f9-8d90-4afc525d08e9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:27 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee Sep 09 16:55:27 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Flow 'volume_create_manager' (ba8023f5-5cec-41c2-a7a2-58923a75f07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1d1fd4-ec2c-4f21-8f89-0bc17a926827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb1d1fd4-ec2c-4f21-8f89-0bc17a926827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-362568834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c43dcc7-e165-4479-8207-e3fb219cd0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48da36286fd14bf98bafd429af9950a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:28Z,use_quota=True,user_id='ec29e077da614cd5a7f5b4874390f577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79dc5378-21f5-4951-a583-dbfae50d9a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79dc5378-21f5-4951-a583-dbfae50d9a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:27 devstack sudo[100203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 Sep 09 16:55:27 devstack sudo[100203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0da40a8-62e2-4d04-b2d4-6245cbac4510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 16:55:27 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:27 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Attempting download of c8a55b28-da06-4b7e-8774-d16bdd532dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}])) to volume 32cc1ebf-2826-4176-8d89-b58fe54f48ee. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1197}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f491f36d-7d39-4965-b1df-f453af79d447]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_gv4d63tk {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:28 devstack sudo[100203]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527" returned: 0 in 0.489s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:28 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527 Sep 09 16:55:28 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:28 devstack sudo[100209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_gv4d63tk Sep 09 16:55:28 devstack sudo[100209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0da40a8-62e2-4d04-b2d4-6245cbac4510) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c43dcc7-e165-4479-8207-e3fb219cd0f7', 'volume_name': 'volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8bc2d4-2411-472e-8986-588dbd20ba9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c8bc2d4-2411-472e-8986-588dbd20ba9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45c642c-065b-48dd-b2c5-2cd2da060459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Volume 1c43dcc7-e165-4479-8207-e3fb219cd0f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Trying to clone 1c43dcc7-e165-4479-8207-e3fb219cd0f7 from image c8a55b28-da06-4b7e-8774-d16bdd532dbb at location (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 16:55:28 devstack sudo[100209]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_gv4d63tk" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_gv4d63tk {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:28 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-30ed5540-e6ed-45ca-8ae6-260f314e3527" returned: 0 in 0.320s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Lock "cinder-quobyte-30ed5540-e6ed-45ca-8ae6-260f314e3527" released by "delete_volume" :: held 0.903s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:28 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_gv4d63tk Sep 09 16:55:28 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Created reservations ['5460d001-feb8-4bde-945a-a132a0bf0b13', '6f159a79-0ab8-4229-8fb6-3045a373b813', 'c0c3df8e-eb5f-4f9c-a480-fb7d9a87cdad', 'c99f50d8-dc8e-47f4-9ca1-a098348053e2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 16:55:28 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Image download 20.69 MB at 20.69 MB/s Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:28 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:28 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[329f9d1b-344b-4668-9090-419a4c913364]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:28 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_gv4d63tk" returned: 1 in 0.470s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb_gv4d63tk' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cbadc1-a0bb-4172-b18e-519a4fb96ef5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:29 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD Sep 09 16:55:29 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:29 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD Sep 09 16:55:29 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:29 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Deleted volume successfully. Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b93b9d44-1b96-44c5-8c0a-3024ee0864f8 tempest-VolumesExtendTest-996616966 None] Lock "cinder-30ed5540-e6ed-45ca-8ae6-260f314e3527-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:29 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Temporary image c8a55b28-da06-4b7e-8774-d16bdd532dbb is fetched for user ec29e077da614cd5a7f5b4874390f577. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 16:55:29 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] c8a55b28-da06-4b7e-8774-d16bdd532dbb was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8237c355-3cd9-420d-8157-2fac0c6e77a6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:29 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee Sep 09 16:55:29 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:29 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD Sep 09 16:55:29 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:29 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-362568834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c43dcc7-e165-4479-8207-e3fb219cd0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48da36286fd14bf98bafd429af9950a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:28Z,use_quota=True,user_id='ec29e077da614cd5a7f5b4874390f577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Creating volume 1c43dcc7-e165-4479-8207-e3fb219cd0f7 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:55:29 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:55:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:29 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 1073741824 Sep 09 16:55:29 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:30 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 1073741824" returned: 0 in 0.688s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:30 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 Sep 09 16:55:30 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:30 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7" returned: 0 in 0.325s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:55:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:30 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Attempting download of c8a55b28-da06-4b7e-8774-d16bdd532dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}])) to volume 1c43dcc7-e165-4479-8207-e3fb219cd0f7. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1197}} Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f11e7c5-7be2-4570-a9a5-292d7dae1e06]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb__n76j01t {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:31 devstack sudo[100258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb__n76j01t Sep 09 16:55:31 devstack sudo[100258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:31 devstack sudo[100258]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb__n76j01t" returned: 0 in 0.367s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb__n76j01t {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:31 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb__n76j01t Sep 09 16:55:31 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:31 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee" returned: 0 in 2.190s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_4st7ssdhdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:55:31 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Converted 112.00 MB image at 51.12 MB/s Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:31 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee 1G Sep 09 16:55:31 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:31 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb__n76j01t" returned: 1 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c8a55b28-da06-4b7e-8774-d16bdd532dbb__n76j01t' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3d4253-35a6-4305-bf57-f22eb2fa253c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:31 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD Sep 09 16:55:31 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:32 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee 1G" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Downloaded image c8a55b28-da06-4b7e-8774-d16bdd532dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}])) to volume 32cc1ebf-2826-4176-8d89-b58fe54f48ee successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1242}} Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Temporary image c8a55b28-da06-4b7e-8774-d16bdd532dbb for user 4eab33ae6b58433dbd0808d7b66c419b is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Marking volume 32cc1ebf-2826-4176-8d89-b58fe54f48ee as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1146}} Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Copying metadata from image c8a55b28-da06-4b7e-8774-d16bdd532dbb to 32cc1ebf-2826-4176-8d89-b58fe54f48ee. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Creating volume glance metadata for volume 32cc1ebf-2826-4176-8d89-b58fe54f48ee backed by image c8a55b28-da06-4b7e-8774-d16bdd532dbb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342c0616-ba9b-41f7-b11c-f182e3dd54c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3ce4d1-26dc-4ffc-9117-7b685b32a356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Volume volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee (32cc1ebf-2826-4176-8d89-b58fe54f48ee): created successfully Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f3ce4d1-26dc-4ffc-9117-7b685b32a356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Flow 'volume_create_manager' (1d8edfe2-e675-48e6-865a-a236d369ce42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f2431243-5aef-4aaa-b00d-c529238fca35 tempest-VolumesImageMetadata-1982505348 None] Created volume successfully. Sep 09 16:55:32 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] c8a55b28-da06-4b7e-8774-d16bdd532dbb was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 16:55:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:32 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 Sep 09 16:55:32 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Acquiring lock "cinder-32cc1ebf-2826-4176-8d89-b58fe54f48ee-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Lock "cinder-32cc1ebf-2826-4176-8d89-b58fe54f48ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Acquiring lock "cinder-quobyte-32cc1ebf-2826-4176-8d89-b58fe54f48ee" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Lock "cinder-quobyte-32cc1ebf-2826-4176-8d89-b58fe54f48ee" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7520dc72-7b09-4d00-8ebb-635e89dce7c6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:33 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee Sep 09 16:55:33 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:34 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee" returned: 0 in 0.550s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:34 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee Sep 09 16:55:34 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:34 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-32cc1ebf-2826-4176-8d89-b58fe54f48ee" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Lock "cinder-quobyte-32cc1ebf-2826-4176-8d89-b58fe54f48ee" released by "delete_volume" :: held 0.964s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Created reservations ['c71992f7-882d-49b3-84e2-4bd1a58ba7d1', '117aba2c-56e2-497d-a5dd-90b812a2e06c', 'd9af32c7-6d4d-4671-a47a-46b15d93f283', '286cd206-6d32-4d7a-9d99-6379a83dc2b6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:34 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7" returned: 0 in 2.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c8a55b28-da06-4b7e-8774-d16bdd532dbb_8npids9kdevstack@QuobyteHD, size 112.00 MB, duration 2.39 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:55:34 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Converted 112.00 MB image at 46.93 MB/s Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5f68f641-957a-4113-a5ee-16a20967163c tempest-GroupsV320Test-1276481309 None] Group tempest-GroupsV320Test-Group-1613750616: creating Sep 09 16:55:34 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 1G Sep 09 16:55:34 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5f68f641-957a-4113-a5ee-16a20967163c tempest-GroupsV320Test-1276481309 None] Group tempest-GroupsV320Test-Group-1613750616: created successfully Sep 09 16:55:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5f68f641-957a-4113-a5ee-16a20967163c tempest-GroupsV320Test-1276481309 None] Create group completed successfully. Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:34 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:34 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:35 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 1G" returned: 0 in 0.431s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Downloaded image c8a55b28-da06-4b7e-8774-d16bdd532dbb ((None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}])) to volume 1c43dcc7-e165-4479-8207-e3fb219cd0f7 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1242}} Sep 09 16:55:35 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Temporary image c8a55b28-da06-4b7e-8774-d16bdd532dbb for user ec29e077da614cd5a7f5b4874390f577 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Marking volume 1c43dcc7-e165-4479-8207-e3fb219cd0f7 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1146}} Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.325s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Deleted volume successfully. Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Copying metadata from image c8a55b28-da06-4b7e-8774-d16bdd532dbb to 1c43dcc7-e165-4479-8207-e3fb219cd0f7. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Creating volume glance metadata for volume 1c43dcc7-e165-4479-8207-e3fb219cd0f7 backed by image c8a55b28-da06-4b7e-8774-d16bdd532dbb with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c3a19faa-d93a-4c4e-8764-f7ed2dde9dde tempest-VolumesImageMetadata-1982505348 None] Lock "cinder-32cc1ebf-2826-4176-8d89-b58fe54f48ee-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c45c642c-065b-48dd-b2c5-2cd2da060459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7', 'volume_size': 1, 'image_id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ea61e1aa34334c6eb11b7f8caecac127', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'c8a55b28-da06-4b7e-8774-d16bdd532dbb', 'created_at': datetime.datetime(2026, 9, 9, 14, 39, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 39, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c8a55b28-da06-4b7e-8774-d16bdd532dbb/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c96c775-52cf-4c22-8f16-00f9780da0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Volume volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 (1c43dcc7-e165-4479-8207-e3fb219cd0f7): created successfully Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c96c775-52cf-4c22-8f16-00f9780da0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Flow 'volume_create_manager' (ba8023f5-5cec-41c2-a7a2-58923a75f07f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5b3a35c6-8ada-4482-8fc0-7bb343b5e799 tempest-TestShelveInstance-1782761603 None] Created volume successfully. Sep 09 16:55:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-06014746-195d-4a9d-91eb-26a5658bb5d6 tempest-GroupsV320Test-1276481309 None] Created reservations ['d966d318-caa6-42eb-b85c-98bfa6a67503'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-06014746-195d-4a9d-91eb-26a5658bb5d6 tempest-GroupsV320Test-1276481309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-06014746-195d-4a9d-91eb-26a5658bb5d6 tempest-GroupsV320Test-1276481309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-06014746-195d-4a9d-91eb-26a5658bb5d6 tempest-GroupsV320Test-1276481309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-06014746-195d-4a9d-91eb-26a5658bb5d6 tempest-GroupsV320Test-1276481309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-06014746-195d-4a9d-91eb-26a5658bb5d6 tempest-GroupsV320Test-1276481309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-06014746-195d-4a9d-91eb-26a5658bb5d6 tempest-GroupsV320Test-1276481309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:36 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:36 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:36 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-06014746-195d-4a9d-91eb-26a5658bb5d6 tempest-GroupsV320Test-1276481309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-06014746-195d-4a9d-91eb-26a5658bb5d6 tempest-GroupsV320Test-1276481309 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-06014746-195d-4a9d-91eb-26a5658bb5d6 tempest-GroupsV320Test-1276481309 None] Delete group completed successfully. Sep 09 16:55:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ee4f870f-44b1-440d-b89c-8de3c1faf0dc req-e999d4a8-4daf-4806-92b5-ebf0e3e1818a tempest-TestShelveInstance-1782761603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ee4f870f-44b1-440d-b89c-8de3c1faf0dc req-e999d4a8-4daf-4806-92b5-ebf0e3e1818a tempest-TestShelveInstance-1782761603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ee4f870f-44b1-440d-b89c-8de3c1faf0dc req-e999d4a8-4daf-4806-92b5-ebf0e3e1818a tempest-TestShelveInstance-1782761603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-ee4f870f-44b1-440d-b89c-8de3c1faf0dc req-e999d4a8-4daf-4806-92b5-ebf0e3e1818a tempest-TestShelveInstance-1782761603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '49c890aa-a08d-4387-8cf0-6c426316a45d', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:55:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-ee4f870f-44b1-440d-b89c-8de3c1faf0dc req-e999d4a8-4daf-4806-92b5-ebf0e3e1818a tempest-TestShelveInstance-1782761603 None] attachment_update completed successfully. Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:45 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:45 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:45 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:55:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Flow 'volume_create_manager' (0d15b9b2-e60d-4e92-858f-ce0c170758ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099b9b32-d8ae-499e-89ad-20a5d04ea590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (099b9b32-d8ae-499e-89ad-20a5d04ea590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-445935667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ab111f-112c-42c2-9e42-c52f69c74fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11db6b5f5af435e9af616a21f21038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:49Z,use_quota=True,user_id='de63db12eddc4e089f02a22428af65f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a6333e-e557-41dc-84d2-a362a3beb822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56a6333e-e557-41dc-84d2-a362a3beb822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83af6944-e07a-4833-9d4b-d743660bfe0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83af6944-e07a-4833-9d4b-d743660bfe0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ab111f-112c-42c2-9e42-c52f69c74fd8', 'volume_name': 'volume-11ab111f-112c-42c2-9e42-c52f69c74fd8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1798a2f-c789-467c-bae2-d7db78c07bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1798a2f-c789-467c-bae2-d7db78c07bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d4816a-b4ee-4001-8026-92fd0fdaa312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Volume 11ab111f-112c-42c2-9e42-c52f69c74fd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ab111f-112c-42c2-9e42-c52f69c74fd8', 'volume_size': 1} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-445935667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ab111f-112c-42c2-9e42-c52f69c74fd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11db6b5f5af435e9af616a21f21038a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:49Z,use_quota=True,user_id='de63db12eddc4e089f02a22428af65f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Creating volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:55:48 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:55:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:48 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 1073741824 Sep 09 16:55:48 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Flow 'volume_create_manager' (a0f72da6-85aa-4dce-bb21-d879d06bd702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c193e6-fe8e-4974-aa55-eff01fbc825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c193e6-fe8e-4974-aa55-eff01fbc825d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2029852277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0166afa-90a0-4732-b254-9053b06af8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3e92181c95451ab9d0012d134ddeed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:49Z,use_quota=True,user_id='1265dea1c11047c0abf95feb8bfdf0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0ed30d-3ade-454a-a8eb-979ffa17459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f0ed30d-3ade-454a-a8eb-979ffa17459d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d705a2d8-102b-47ac-b630-2cd3b5c656b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d705a2d8-102b-47ac-b630-2cd3b5c656b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0166afa-90a0-4732-b254-9053b06af8d5', 'volume_name': 'volume-e0166afa-90a0-4732-b254-9053b06af8d5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4de460-7d13-40b6-910e-8848f6a9b51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf4de460-7d13-40b6-910e-8848f6a9b51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b61d85e-df3f-491a-a4e5-7c29218b0c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Volume e0166afa-90a0-4732-b254-9053b06af8d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0166afa-90a0-4732-b254-9053b06af8d5', 'volume_size': 1} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:49 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 1073741824" returned: 0 in 0.850s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:49 devstack sudo[100775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 Sep 09 16:55:49 devstack sudo[100775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:50 devstack sudo[100775]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8" returned: 0 in 0.489s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.084s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:55:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2029852277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0166afa-90a0-4732-b254-9053b06af8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3e92181c95451ab9d0012d134ddeed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:55:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:55:49Z,use_quota=True,user_id='1265dea1c11047c0abf95feb8bfdf0da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Creating volume e0166afa-90a0-4732-b254-9053b06af8d5 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:55:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:50 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5 1073741824 Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d4816a-b4ee-4001-8026-92fd0fdaa312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ab111f-112c-42c2-9e42-c52f69c74fd8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:50 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc664aa-b6d9-42f6-96be-9f47c0fa86df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Volume volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 (11ab111f-112c-42c2-9e42-c52f69c74fd8): created successfully Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bc664aa-b6d9-42f6-96be-9f47c0fa86df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Flow 'volume_create_manager' (0d15b9b2-e60d-4e92-858f-ce0c170758ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aecaab1d-f9f0-4a83-948c-c7b5a601964c tempest-SnapshotsActionsTest-1601883036 None] Created volume successfully. Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:51 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5 1073741824" returned: 0 in 0.809s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:51 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5 Sep 09 16:55:51 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:51 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5" returned: 0 in 0.498s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.596s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b61d85e-df3f-491a-a4e5-7c29218b0c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0166afa-90a0-4732-b254-9053b06af8d5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341de683-5379-40cd-a3ff-686433a1ccef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Creating offline snapshot 1fbe9423-d9c0-4879-8a73-685bbe55b8f2 of volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:55:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Volume volume-e0166afa-90a0-4732-b254-9053b06af8d5 (e0166afa-90a0-4732-b254-9053b06af8d5): created successfully Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (341de683-5379-40cd-a3ff-686433a1ccef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Flow 'volume_create_manager' (a0f72da6-85aa-4dce-bb21-d879d06bd702) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2441eb-fa4c-4ebf-a565-a2b98a915632]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9e722dac-0efd-4d46-9da6-e97664425e74 tempest-AbsoluteLimitsTests-672119939 None] Created volume successfully. Sep 09 16:55:51 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 Sep 09 16:55:51 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:52 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8" returned: 0 in 0.523s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:52 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 1G Sep 09 16:55:52 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Acquiring lock "cinder-e0166afa-90a0-4732-b254-9053b06af8d5-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Lock "cinder-e0166afa-90a0-4732-b254-9053b06af8d5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Acquiring lock "cinder-quobyte-e0166afa-90a0-4732-b254-9053b06af8d5" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:55:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Lock "cinder-quobyte-e0166afa-90a0-4732-b254-9053b06af8d5" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:55:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a447ffc8-bf27-405f-a4fa-194d5cd4c4b5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:52 devstack sudo[100810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5 Sep 09 16:55:52 devstack sudo[100810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:52 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 1G" returned: 0 in 0.633s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:53 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:55:53 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:53 devstack sudo[100810]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5" returned: 0 in 0.636s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:53 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5 Sep 09 16:55:53 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:53 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.469s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:53 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 is being set with open permissions: ugo+rw Sep 09 16:55:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:53 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:55:53 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:53 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0166afa-90a0-4732-b254-9053b06af8d5" returned: 0 in 0.446s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Lock "cinder-quobyte-e0166afa-90a0-4732-b254-9053b06af8d5" released by "delete_volume" :: held 1.137s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Created reservations ['7610c1f0-638d-40ea-85fb-1271983ddf56', 'c2c3970c-2f93-4d68-af1b-b4778b6ef412', '1f7d0706-b162-42c2-b20d-6618a4d07c44', 'dd2921eb-f17c-4a27-b57a-64bb008ae3f5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:55:53 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=138,cinder:INSERT=51,cinder:UPDATE=146,cinder:DELETE=10 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:55:53 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=137,cinder:SELECT=132,cinder:INSERT=49,cinder:DELETE=9 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:55:54 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.639s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:54 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:55:54 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:54 devstack sudo[100829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.info Sep 09 16:55:54 devstack sudo[100829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:54 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:55:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Deleted volume successfully. Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e4718cf-de39-44b4-abed-dc2a6b92b427 tempest-AbsoluteLimitsTests-672119939 None] Lock "cinder-e0166afa-90a0-4732-b254-9053b06af8d5-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:55:54 devstack sudo[100829]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.info" returned: 0 in 0.421s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.info is being set with open permissions: ugo+rw Sep 09 16:55:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:54 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.info Sep 09 16:55:54 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:55 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.info" returned: 0 in 0.520s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.414s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e043cda1-74c6-4b35-9186-c386c00a4afc tempest-SnapshotsActionsTest-1601883036 None] Create snapshot completed successfully Sep 09 16:55:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:55:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:55:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] Creating offline snapshot c939e118-b5dd-4df8-b7b6-43504012bab6 of volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:55:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe8c4da-3a05-4916-8413-d0dff28579c5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:55:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:57 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:55:57 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:57 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.663s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:55:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:57 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 1G Sep 09 16:55:57 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:58 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 1G" returned: 0 in 0.765s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:58 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 Sep 09 16:55:58 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:59 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:59 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 is being set with open permissions: ugo+rw Sep 09 16:55:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:55:59 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 Sep 09 16:55:59 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:55:59 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Sep 09 16:55:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:55:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.396s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:55:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d4ee47ae-30c4-4d90-ba45-52deb5b5d34f tempest-SnapshotsActionsTest-1601883036 None] Create snapshot completed successfully Sep 09 16:56:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-c939e118-b5dd-4df8-b7b6-43504012bab6-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-c939e118-b5dd-4df8-b7b6-43504012bab6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-quobyte-c939e118-b5dd-4df8-b7b6-43504012bab6" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-c939e118-b5dd-4df8-b7b6-43504012bab6" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Deleting offline snapshot c939e118-b5dd-4df8-b7b6-43504012bab6 of volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:56:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] snapshot_file for this snap is: volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:56:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d4f0e8-3137-4b54-bb73-b23ec8121253]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:00 devstack sudo[100862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 Sep 09 16:56:00 devstack sudo[100862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:01 devstack sudo[100862]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6" returned: 0 in 0.602s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a61080-8f2f-4ad5-becb-02578a26b206]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:01 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:56:01 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:01 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.533s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:01 devstack sudo[100872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 Sep 09 16:56:01 devstack sudo[100872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:02 devstack sudo[100872]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6" returned: 0 in 0.621s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:02 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6 Sep 09 16:56:02 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:02 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.c939e118-b5dd-4df8-b7b6-43504012bab6" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-c939e118-b5dd-4df8-b7b6-43504012bab6" released by "_delete_snapshot" :: held 2.285s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" released by "delete_snapshot" :: held 2.347s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Created reservations ['bd5c6dc4-0d41-4634-9abd-c53b8b539511', '8b82f34a-597a-4acb-a027-8612c74e5f13', '22ec0d24-6441-42f4-b855-78387d32469a', 'd60aa89c-8d12-40d0-b0b6-7d2966d5a3d5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:56:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Delete snapshot completed successfully. Sep 09 16:56:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b110532-c5e1-4058-9c2a-cafbb6cca985 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-c939e118-b5dd-4df8-b7b6-43504012bab6-delete_snapshot" released by "delete_snapshot" :: held 2.638s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] Creating offline snapshot 5c33dbe0-1890-4b7e-9428-810f3854d723 of volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:56:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[290d78a5-a632-4b5b-a51b-188de78b4a4a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:04 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:56:04 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:04 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.447s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:04 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 1G Sep 09 16:56:04 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:05 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 1G" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:05 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 Sep 09 16:56:05 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:05 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:05 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 is being set with open permissions: ugo+rw Sep 09 16:56:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:05 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 Sep 09 16:56:05 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:06 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723" returned: 0 in 0.323s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.755s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d9909305-0481-464b-895f-470277a1344b tempest-SnapshotsActionsTest-1601883036 None] Create snapshot completed successfully Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-5c33dbe0-1890-4b7e-9428-810f3854d723-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Flow 'volume_create_manager' (61db6a18-683b-4aeb-9a4f-18c92b4b6eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8be5ce2-ba01-4a67-b193-448663a981ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-5c33dbe0-1890-4b7e-9428-810f3854d723-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8be5ce2-ba01-4a67-b193-448663a981ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1963367863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70ee384-3263-4de0-9462-d1fa9b6557d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd84d7832154cbbaeda03637f6d05a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:56:07Z,use_quota=True,user_id='39473ab686564c5fb4587a29ce97095e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928fa3e2-7871-4e15-8c40-fb152b969f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (928fa3e2-7871-4e15-8c40-fb152b969f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c97303-06aa-4d29-a2cb-beef729db6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c97303-06aa-4d29-a2cb-beef729db6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70ee384-3263-4de0-9462-d1fa9b6557d9', 'volume_name': 'volume-c70ee384-3263-4de0-9462-d1fa9b6557d9', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def9f523-02c3-4f22-acf6-4150425a4957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def9f523-02c3-4f22-acf6-4150425a4957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b9d348-64b7-4561-b7e4-28ba881603fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Volume c70ee384-3263-4de0-9462-d1fa9b6557d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70ee384-3263-4de0-9462-d1fa9b6557d9', 'volume_size': 1} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:56:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1963367863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70ee384-3263-4de0-9462-d1fa9b6557d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd84d7832154cbbaeda03637f6d05a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:56:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:56:07Z,use_quota=True,user_id='39473ab686564c5fb4587a29ce97095e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Creating volume c70ee384-3263-4de0-9462-d1fa9b6557d9 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:56:06 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" acquired by "delete_snapshot" :: waited 0.102s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-quobyte-5c33dbe0-1890-4b7e-9428-810f3854d723" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-5c33dbe0-1890-4b7e-9428-810f3854d723" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Deleting offline snapshot 5c33dbe0-1890-4b7e-9428-810f3854d723 of volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:56:06 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9 1073741824 Sep 09 16:56:06 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] snapshot_file for this snap is: volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd572393-402d-480f-bf9a-787044c7e714]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:07 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 Sep 09 16:56:07 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:07 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723" returned: 0 in 0.458s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c7826f-996f-4f30-8ddc-cbe946ae960e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:07 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9 1073741824" returned: 0 in 0.677s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:07 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:56:07 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:07 devstack sudo[100917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9 Sep 09 16:56:07 devstack sudo[100917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:07 devstack sudo[100917]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56b9d348-64b7-4561-b7e4-28ba881603fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70ee384-3263-4de0-9462-d1fa9b6557d9', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eeac837-699b-49ff-a565-31b29b84df50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Volume volume-c70ee384-3263-4de0-9462-d1fa9b6557d9 (c70ee384-3263-4de0-9462-d1fa9b6557d9): created successfully Sep 09 16:56:07 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eeac837-699b-49ff-a565-31b29b84df50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Flow 'volume_create_manager' (61db6a18-683b-4aeb-9a4f-18c92b4b6eda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.554s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bc4626c6-60f9-4049-93cb-2b0819407255 tempest-VolumesTransfersV357Test-790146126 None] Created volume successfully. Sep 09 16:56:07 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 Sep 09 16:56:07 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:08 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723" returned: 0 in 0.476s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:08 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723 Sep 09 16:56:08 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:08 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.5c33dbe0-1890-4b7e-9428-810f3854d723" returned: 0 in 0.281s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-5c33dbe0-1890-4b7e-9428-810f3854d723" released by "_delete_snapshot" :: held 1.886s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" released by "delete_snapshot" :: held 1.917s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Created reservations ['2ceff676-9e3b-4a35-a6a0-99817f1158b1', 'ef22fb05-c721-407f-9611-82ba32475542', '64c94005-b4d1-49ab-b224-a947dcf621f4', '67146c97-46e1-4436-89f7-6abbe223c6ca'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:56:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Delete snapshot completed successfully. Sep 09 16:56:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-145eb059-9ea9-47e1-b740-ae29697a0d95 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-5c33dbe0-1890-4b7e-9428-810f3854d723-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e9282057-b1a0-4c68-9cd0-be0efff7eb76 tempest-VolumesTransfersV357Test-2121221426 None] Transfer volume completed successfully. Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Acquiring lock "cinder-c70ee384-3263-4de0-9462-d1fa9b6557d9-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Lock "cinder-c70ee384-3263-4de0-9462-d1fa9b6557d9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Acquiring lock "cinder-quobyte-c70ee384-3263-4de0-9462-d1fa9b6557d9" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Lock "cinder-quobyte-c70ee384-3263-4de0-9462-d1fa9b6557d9" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[198088de-4a99-4588-b3ba-db0a0713a5ab]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] Creating offline snapshot 82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 of volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[97cf11a4-d5ba-40c0-9165-3a6796f2e300]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:10 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9 Sep 09 16:56:10 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:10 devstack sudo[100972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:56:10 devstack sudo[100972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:10 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9" returned: 0 in 0.492s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:10 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9 Sep 09 16:56:10 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:10 devstack sudo[100972]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.474s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:10 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 1G Sep 09 16:56:10 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:11 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c70ee384-3263-4de0-9462-d1fa9b6557d9" returned: 0 in 0.387s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Lock "cinder-quobyte-c70ee384-3263-4de0-9462-d1fa9b6557d9" released by "delete_volume" :: held 0.948s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Created reservations ['c1b43eff-50fe-4e16-8365-cbe777a6f5f1', '3be68526-f577-4293-a59d-4c61c9e22fee', '7c85fb8c-640d-4f91-8040-11280b282254', 'e3bb763b-246b-41b5-bd0c-0606ee1048a0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:11 devstack sudo[100990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:56:11 devstack sudo[100990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:11 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 1G" returned: 0 in 0.764s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:11 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 Sep 09 16:56:11 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:11 devstack sudo[100990]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:56:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Deleted volume successfully. Sep 09 16:56:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-db9ec6c6-35c8-4ea4-8855-229e2f1986ca tempest-VolumesTransfersV357Test-1634609673 None] Lock "cinder-c70ee384-3263-4de0-9462-d1fa9b6557d9-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:12 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:12 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 is being set with open permissions: ugo+rw Sep 09 16:56:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:12 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 Sep 09 16:56:12 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:12 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1eb82db3-2782-421a-9672-f8804aff16c6 tempest-SnapshotsActionsTest-1601883036 None] Create snapshot completed successfully Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Flow 'volume_create_manager' (9155fb60-5974-4069-921d-2fd8e973a210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48c126b-0158-4fce-886f-8e1a124631ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48c126b-0158-4fce-886f-8e1a124631ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1178038718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb6f962-48e7-43ab-a273-e1706a053e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd84d7832154cbbaeda03637f6d05a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:56:13Z,use_quota=True,user_id='39473ab686564c5fb4587a29ce97095e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5ba1a9-2098-41f4-962b-f5a4d79446b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5ba1a9-2098-41f4-962b-f5a4d79446b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7b0648-54fe-49e2-8866-2a2daa562d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7b0648-54fe-49e2-8866-2a2daa562d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb6f962-48e7-43ab-a273-e1706a053e56', 'volume_name': 'volume-dcb6f962-48e7-43ab-a273-e1706a053e56', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6390cbf-f3cf-44a8-a969-080c8bf57863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6390cbf-f3cf-44a8-a969-080c8bf57863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce279b3-a231-42f3-8965-892808511d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:13 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Volume dcb6f962-48e7-43ab-a273-e1706a053e56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb6f962-48e7-43ab-a273-e1706a053e56', 'volume_size': 1} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:56:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1178038718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb6f962-48e7-43ab-a273-e1706a053e56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfd84d7832154cbbaeda03637f6d05a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:56:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:56:13Z,use_quota=True,user_id='39473ab686564c5fb4587a29ce97095e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Creating volume dcb6f962-48e7-43ab-a273-e1706a053e56 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:56:13 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:13 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56 1073741824 Sep 09 16:56:13 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-quobyte-82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593" acquired by "_delete_snapshot" :: waited 0.070s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Deleting offline snapshot 82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 of volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] snapshot_file for this snap is: volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:56:13 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56 1073741824" returned: 0 in 0.681s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd26378-01b4-44b8-907f-fa38e58426c7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:14 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56 Sep 09 16:56:14 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:14 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 Sep 09 16:56:14 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:14 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56" returned: 0 in 0.428s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cce279b3-a231-42f3-8965-892808511d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb6f962-48e7-43ab-a273-e1706a053e56', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4109e627-0cf0-4dac-b8c8-dd0eb59eb688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Volume volume-dcb6f962-48e7-43ab-a273-e1706a053e56 (dcb6f962-48e7-43ab-a273-e1706a053e56): created successfully Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4109e627-0cf0-4dac-b8c8-dd0eb59eb688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Flow 'volume_create_manager' (9155fb60-5974-4069-921d-2fd8e973a210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:56:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0afbfcb8-9caa-465f-be68-ba7e99401f35 tempest-VolumesTransfersV357Test-790146126 None] Created volume successfully. Sep 09 16:56:14 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593" returned: 0 in 0.795s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a24faca-def9-4fa6-85db-061f8fa13151]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:15 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:56:15 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:15 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.840s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:15 devstack sudo[101131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 Sep 09 16:56:15 devstack sudo[101131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Acquiring lock "cinder-dcb6f962-48e7-43ab-a273-e1706a053e56-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Lock "cinder-dcb6f962-48e7-43ab-a273-e1706a053e56-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Acquiring lock "cinder-quobyte-dcb6f962-48e7-43ab-a273-e1706a053e56" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:16 devstack sudo[101131]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593" returned: 0 in 0.995s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:16 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593 Sep 09 16:56:16 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Lock "cinder-quobyte-dcb6f962-48e7-43ab-a273-e1706a053e56" acquired by "delete_volume" :: waited 0.056s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9efa960-affc-48b3-96e0-5c03ce0e398d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:16 devstack sudo[101141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56 Sep 09 16:56:16 devstack sudo[101141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:17 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593" released by "_delete_snapshot" :: held 3.264s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" released by "delete_snapshot" :: held 3.349s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Created reservations ['a22e8c6a-8f02-421a-b6f1-d5e8adea7192', '696561d0-b332-4f85-ba03-2c4d3d338b73', 'dd64f290-b698-486e-8b2c-ce997a540101', '7d1cd347-8440-45cf-9f01-1f4894cc2aa2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:56:17 devstack sudo[101141]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56" returned: 0 in 0.603s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Delete snapshot completed successfully. Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d4fa7e90-1e47-41db-aeb0-288e7f481679 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-82d1e6e7-ffa2-443a-83aa-bc0f8a0b0593-delete_snapshot" released by "delete_snapshot" :: held 3.626s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:17 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56 Sep 09 16:56:17 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:17 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-dcb6f962-48e7-43ab-a273-e1706a053e56" returned: 0 in 0.328s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Lock "cinder-quobyte-dcb6f962-48e7-43ab-a273-e1706a053e56" released by "delete_volume" :: held 1.005s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Created reservations ['5a35e144-080a-4f01-bfac-00cbc13168f9', 'a033d716-a96d-4d3a-89f1-9ac6739e217d', '356a496f-7cc0-4af5-bb0f-30c8022ee615', '50791c6e-d8ea-4b9b-92cc-31c7a4593f76'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:17 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:56:17 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:18 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.354s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:56:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Deleted volume successfully. Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fb6e1655-9284-4180-8ad9-59ad51a626c2 tempest-VolumesTransfersV357Test-1634609673 None] Lock "cinder-dcb6f962-48e7-43ab-a273-e1706a053e56-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Flow 'volume_create_manager' (f4857f76-569b-4747-bae8-48a88073e47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd95150-598d-4250-8908-938904afd1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd95150-598d-4250-8908-938904afd1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1575442175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6017cec0-bef9-47b3-ab0b-30f7baf5974c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4006d1cd034457ad5ee29831b3286c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:56:19Z,use_quota=True,user_id='fa8c4447b02b46f1a7a921c150c3d9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0832f8-8bd0-446f-b80b-6565bca98644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb0832f8-8bd0-446f-b80b-6565bca98644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c7c282-3b95-4041-9b53-7133953d3137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45c7c282-3b95-4041-9b53-7133953d3137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6017cec0-bef9-47b3-ab0b-30f7baf5974c', 'volume_name': 'volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19629f05-3dcc-4b55-bbc2-66b93b47aff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19629f05-3dcc-4b55-bbc2-66b93b47aff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36118dfe-2687-4b60-96bc-de7308179d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Volume 6017cec0-bef9-47b3-ab0b-30f7baf5974c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c', 'volume_size': 1} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1575442175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6017cec0-bef9-47b3-ab0b-30f7baf5974c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d4006d1cd034457ad5ee29831b3286c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:56:19Z,use_quota=True,user_id='fa8c4447b02b46f1a7a921c150c3d9ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Creating volume 6017cec0-bef9-47b3-ab0b-30f7baf5974c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:56:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:56:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:18 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c 1073741824 Sep 09 16:56:18 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:19 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c 1073741824" returned: 0 in 0.770s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:19 devstack sudo[101172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c Sep 09 16:56:19 devstack sudo[101172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:20 devstack sudo[101172]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.121s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36118dfe-2687-4b60-96bc-de7308179d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d04265d-909d-4d34-9ae5-318d0195e1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] Creating offline snapshot 6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 of volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:56:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Volume volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c (6017cec0-bef9-47b3-ab0b-30f7baf5974c): created successfully Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d04265d-909d-4d34-9ae5-318d0195e1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Flow 'volume_create_manager' (f4857f76-569b-4747-bae8-48a88073e47f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a40af8c-6da0-4bcb-83bf-3a38b508e66b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-29e4e83f-ede4-4986-92ad-6207287def00 tempest-TestMinimumBasicScenario-1384676336 None] Created volume successfully. Sep 09 16:56:20 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:56:20 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:20 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.602s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:20 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 1G Sep 09 16:56:20 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:21 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 1G" returned: 0 in 0.909s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:21 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 Sep 09 16:56:21 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:22 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2" returned: 0 in 0.681s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:22 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 is being set with open permissions: ugo+rw Sep 09 16:56:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:22 devstack sudo[101213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 Sep 09 16:56:22 devstack sudo[101213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-8d2e244a-d8cc-4353-8dac-849a96b9eb8b req-4d5590a5-c950-4828-91af-ef5116e2254c tempest-TestShelveInstance-1782761603 None] Terminate volume connection completed successfully. Sep 09 16:56:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-8d2e244a-d8cc-4353-8dac-849a96b9eb8b req-4d5590a5-c950-4828-91af-ef5116e2254c tempest-TestShelveInstance-1782761603 None] Deleting attachment 49c890aa-a08d-4387-8cf0-6c426316a45d. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:56:23 devstack sudo[101213]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2" returned: 0 in 0.641s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.035s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-28154995-732b-4b5e-8aea-8faf1caf7a9d tempest-SnapshotsActionsTest-1601883036 None] Create snapshot completed successfully Sep 09 16:56:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0a66cf4e-423c-46a1-88c9-ea6ddccdbc7a req-364e71f8-ef86-4c80-8068-71a305af6e67 tempest-TestMinimumBasicScenario-1384676336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0a66cf4e-423c-46a1-88c9-ea6ddccdbc7a req-364e71f8-ef86-4c80-8068-71a305af6e67 tempest-TestMinimumBasicScenario-1384676336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0a66cf4e-423c-46a1-88c9-ea6ddccdbc7a req-364e71f8-ef86-4c80-8068-71a305af6e67 tempest-TestMinimumBasicScenario-1384676336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-0a66cf4e-423c-46a1-88c9-ea6ddccdbc7a req-364e71f8-ef86-4c80-8068-71a305af6e67 tempest-TestMinimumBasicScenario-1384676336 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '196b87e6-40fb-4fa4-81d7-0b49f3aa907e', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:56:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-0a66cf4e-423c-46a1-88c9-ea6ddccdbc7a req-364e71f8-ef86-4c80-8068-71a305af6e67 tempest-TestMinimumBasicScenario-1384676336 None] attachment_update completed successfully. Sep 09 16:56:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.075s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Acquiring lock "cinder-quobyte-6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Deleting offline snapshot 6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 of volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:56:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] snapshot_file for this snap is: volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:56:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c20c8-a604-488d-a8c7-22d7b7255583]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:24 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 Sep 09 16:56:24 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:25 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2" returned: 0 in 0.653s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84017be-1927-4c32-b0ae-c317647bff52]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:25 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:56:25 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:25 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.608s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:25 devstack sudo[101655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 Sep 09 16:56:25 devstack sudo[101655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:26 devstack sudo[101655]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2" returned: 0 in 0.573s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:26 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2 Sep 09 16:56:26 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:26 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2" returned: 0 in 0.468s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2" released by "_delete_snapshot" :: held 2.509s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" released by "delete_snapshot" :: held 2.544s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Created reservations ['2974a730-c5da-4ae9-b3e4-6435e3de96dc', '9e1e3c70-25ee-45ae-8245-275309681d11', '515f5d60-b987-4250-9c90-1818bae49c48', 'acf8e30c-bb7a-4588-b0eb-736f069c02ca'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:56:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Delete snapshot completed successfully. Sep 09 16:56:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-efb3a15b-9e1b-4b8e-a2d0-57348829a0f5 tempest-SnapshotsActionsTest-1222022851 None] Lock "cinder-6fa2fe23-cd94-4fcf-928a-c615b5a4d8b2-delete_snapshot" released by "delete_snapshot" :: held 2.900s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ddcf09be-8b01-4801-91d5-91e0314e1193 req-14ef085e-6932-4e1a-940f-47b4ae173fc3 tempest-TestShelveInstance-1782761603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ddcf09be-8b01-4801-91d5-91e0314e1193 req-14ef085e-6932-4e1a-940f-47b4ae173fc3 tempest-TestShelveInstance-1782761603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-ddcf09be-8b01-4801-91d5-91e0314e1193 req-14ef085e-6932-4e1a-940f-47b4ae173fc3 tempest-TestShelveInstance-1782761603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-ddcf09be-8b01-4801-91d5-91e0314e1193 req-14ef085e-6932-4e1a-940f-47b4ae173fc3 tempest-TestShelveInstance-1782761603 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '963df7a5-da2e-45b5-94e8-e513c5bb1ef7', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:56:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-ddcf09be-8b01-4801-91d5-91e0314e1193 req-14ef085e-6932-4e1a-940f-47b4ae173fc3 tempest-TestShelveInstance-1782761603 None] attachment_update completed successfully. Sep 09 16:56:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "cinder-1fbe9423-d9c0-4879-8a73-685bbe55b8f2-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Lock "cinder-1fbe9423-d9c0-4879-8a73-685bbe55b8f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "cinder-quobyte-1fbe9423-d9c0-4879-8a73-685bbe55b8f2" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Lock "cinder-quobyte-1fbe9423-d9c0-4879-8a73-685bbe55b8f2" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Deleting offline snapshot 1fbe9423-d9c0-4879-8a73-685bbe55b8f2 of volume 11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:56:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] snapshot_file for this snap is: volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:56:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9b1e67-4353-4f86-b31a-5db33b11f239]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:28 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:56:28 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:29 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.725s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11ab111f-112c-42c2-9e42-c52f69c74fd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:56:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[90bebfb6-68d6-43e7-b095-ced880abf70a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:29 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 Sep 09 16:56:29 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:30 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8" returned: 0 in 0.650s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:30 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:56:30 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:30 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:30 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2 Sep 09 16:56:30 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:30 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8.1fbe9423-d9c0-4879-8a73-685bbe55b8f2" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Lock "cinder-quobyte-1fbe9423-d9c0-4879-8a73-685bbe55b8f2" released by "_delete_snapshot" :: held 2.416s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" released by "delete_snapshot" :: held 2.457s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Created reservations ['ff849847-f293-424c-a588-b0b99a1fceb9', 'cb3d52a0-340e-4f56-a6cb-5f6cff1aa78e', '6ea6955b-6c23-4a91-bcdd-8bab7ba3c5c0', '0eeee5a1-6496-4738-bc0a-184d7933da44'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:56:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Delete snapshot completed successfully. Sep 09 16:56:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f2516924-073f-4416-80f3-c741ee26750a tempest-SnapshotsActionsTest-1601883036 None] Lock "cinder-1fbe9423-d9c0-4879-8a73-685bbe55b8f2-delete_snapshot" released by "delete_snapshot" :: held 2.733s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "cinder-11ab111f-112c-42c2-9e42-c52f69c74fd8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Lock "cinder-11ab111f-112c-42c2-9e42-c52f69c74fd8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[500e71a5-68d2-4e51-9c40-0b804797a7e2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:32 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 Sep 09 16:56:32 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Flow 'volume_create_manager' (3ae6f397-3bdb-4073-bdb2-c950612bc069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0ee395-939d-4d7e-b4ca-0b612871234e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa0ee395-939d-4d7e-b4ca-0b612871234e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2009742067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818d660f-5376-4ecc-85ec-be29284a241a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aace9df6040145aabd3805108118424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:56:33Z,use_quota=True,user_id='7880868850934a71b46dae75cc4fccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9041d94-1711-4b72-b5d4-4cc0c5d75805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9041d94-1711-4b72-b5d4-4cc0c5d75805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e198a48-b899-478c-9564-70cda1b5eb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e198a48-b899-478c-9564-70cda1b5eb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818d660f-5376-4ecc-85ec-be29284a241a', 'volume_name': 'volume-818d660f-5376-4ecc-85ec-be29284a241a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4a4260-1d7c-4fe1-845a-2edbea0d4bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4a4260-1d7c-4fe1-845a-2edbea0d4bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6698dfe5-f27a-4058-a7c1-0f48785b0c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Volume 818d660f-5376-4ecc-85ec-be29284a241a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818d660f-5376-4ecc-85ec-be29284a241a', 'volume_size': 1} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2009742067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818d660f-5376-4ecc-85ec-be29284a241a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aace9df6040145aabd3805108118424e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:56:33Z,use_quota=True,user_id='7880868850934a71b46dae75cc4fccb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Creating volume 818d660f-5376-4ecc-85ec-be29284a241a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:56:32 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:56:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:32 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a 1073741824 Sep 09 16:56:32 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:33 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8" returned: 0 in 0.862s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:33 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8 Sep 09 16:56:33 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:33 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-11ab111f-112c-42c2-9e42-c52f69c74fd8" returned: 0 in 0.497s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Lock "cinder-quobyte-11ab111f-112c-42c2-9e42-c52f69c74fd8" released by "delete_volume" :: held 1.515s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Created reservations ['4b94305a-37b7-42f6-b6b9-0990cdc7ef56', 'e2623d24-f100-4c60-8c34-5814bacc5afa', '6bec518f-95d6-4595-8119-e197c2c9455b', 'd20d8aa1-efb2-4247-9169-07498c1138a0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:33 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:56:33 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:33 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a 1073741824" returned: 0 in 1.026s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:34 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a Sep 09 16:56:34 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:34 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:56:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Deleted volume successfully. Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b1b87a-6954-4b8b-9319-f33bbcfe3771 tempest-SnapshotsActionsTest-1601883036 None] Lock "cinder-11ab111f-112c-42c2-9e42-c52f69c74fd8-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:56:34 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] <== create_volume: return (1434ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6698dfe5-f27a-4058-a7c1-0f48785b0c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818d660f-5376-4ecc-85ec-be29284a241a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424f2c0d-58e9-4d72-ab75-51da7843bc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:56:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Volume volume-818d660f-5376-4ecc-85ec-be29284a241a (818d660f-5376-4ecc-85ec-be29284a241a): created successfully Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424f2c0d-58e9-4d72-ab75-51da7843bc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:56:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Flow 'volume_create_manager' (3ae6f397-3bdb-4073-bdb2-c950612bc069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:56:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-74ec686e-da69-45fa-9821-277d641ef696 tempest-VolumesNegativeTest-521469030 None] Created volume successfully. Sep 09 16:56:44 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=69,cinder:SELECT=71,cinder:DELETE=6,cinder:INSERT=20 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:56:44 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=77,cinder:INSERT=17,cinder:UPDATE=81,cinder:DELETE=7 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:56:45 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:56:45 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:56:45 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.711s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:56:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:57:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Acquiring lock "cinder-818d660f-5376-4ecc-85ec-be29284a241a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Lock "cinder-818d660f-5376-4ecc-85ec-be29284a241a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Acquiring lock "cinder-quobyte-818d660f-5376-4ecc-85ec-be29284a241a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Lock "cinder-quobyte-818d660f-5376-4ecc-85ec-be29284a241a" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df67600-67aa-4d81-a019-7e96a8c046b8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:03 devstack sudo[102010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a Sep 09 16:57:03 devstack sudo[102010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:03 devstack sudo[102010]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:04 devstack sudo[102015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a Sep 09 16:57:04 devstack sudo[102015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:04 devstack sudo[102015]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-818d660f-5376-4ecc-85ec-be29284a241a" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Lock "cinder-quobyte-818d660f-5376-4ecc-85ec-be29284a241a" released by "delete_volume" :: held 0.682s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Created reservations ['56dcf66d-7712-4d73-9676-95d461205ebd', '76810722-961f-4b6a-82a7-eb41e366eca5', '7a0974f2-faf6-453f-ad80-f1ee29f8c732', 'a759f43e-05df-42b6-a42c-af789e741d8a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:04 devstack sudo[102018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:04 devstack sudo[102018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:04 devstack sudo[102018]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Deleted volume successfully. Sep 09 16:57:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-47ee49e0-f4c7-44a4-9e4e-e52d0ca750bd tempest-VolumesNegativeTest-521469030 None] Lock "cinder-818d660f-5376-4ecc-85ec-be29284a241a-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Flow 'volume_create_manager' (3faca5b1-a3ca-443f-ab68-ca7631e0ecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8e59d8-9cc7-4640-ab2d-a1b69ed43c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d8e59d8-9cc7-4640-ab2d-a1b69ed43c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1443256937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d60502e-1388-4a65-b874-5a00474c0ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53321fe1a51e49e3aa609c3d60fd162b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:10Z,use_quota=True,user_id='df49bad37be0469898551488f54f19a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ffa92b-71a7-4bb5-a9f6-75c51fd8f063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ffa92b-71a7-4bb5-a9f6-75c51fd8f063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4185e231-9811-41d9-8fc3-9d7eefc8db4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4185e231-9811-41d9-8fc3-9d7eefc8db4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d60502e-1388-4a65-b874-5a00474c0ca7', 'volume_name': 'volume-5d60502e-1388-4a65-b874-5a00474c0ca7', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e29eb8f-bad6-426d-88b4-a270a623c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e29eb8f-bad6-426d-88b4-a270a623c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540380ff-6dab-4f0d-80f6-1feab5d1c5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Volume 5d60502e-1388-4a65-b874-5a00474c0ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d60502e-1388-4a65-b874-5a00474c0ca7', 'volume_size': 1} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1443256937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d60502e-1388-4a65-b874-5a00474c0ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53321fe1a51e49e3aa609c3d60fd162b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:10Z,use_quota=True,user_id='df49bad37be0469898551488f54f19a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Creating volume 5d60502e-1388-4a65-b874-5a00474c0ca7 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:10 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:10 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7 1073741824 Sep 09 16:57:10 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:10 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7 1073741824" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:11 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7 Sep 09 16:57:11 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:11 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (540380ff-6dab-4f0d-80f6-1feab5d1c5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d60502e-1388-4a65-b874-5a00474c0ca7', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7764d78b-0f66-4ce8-a4fa-e15cb6bb7b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Volume volume-5d60502e-1388-4a65-b874-5a00474c0ca7 (5d60502e-1388-4a65-b874-5a00474c0ca7): created successfully Sep 09 16:57:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7764d78b-0f66-4ce8-a4fa-e15cb6bb7b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Flow 'volume_create_manager' (3faca5b1-a3ca-443f-ab68-ca7631e0ecd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-92041151-99e0-4881-aa99-f27f0141fe25 tempest-VolumesTransfersTest-1249896948 None] Created volume successfully. Sep 09 16:57:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ebe4e94b-4f92-4263-a528-e0a3301b565b tempest-VolumesTransfersTest-105252458 None] Transfer volume completed successfully. Sep 09 16:57:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-04b45df6-c34a-42f1-9d6a-e18e5871bbd4 req-94587173-2ece-4c50-87b1-f96ad0709e95 tempest-TestMinimumBasicScenario-1384676336 None] Terminate volume connection completed successfully. Sep 09 16:57:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-04b45df6-c34a-42f1-9d6a-e18e5871bbd4 req-94587173-2ece-4c50-87b1-f96ad0709e95 tempest-TestMinimumBasicScenario-1384676336 None] Deleting attachment 196b87e6-40fb-4fa4-81d7-0b49f3aa907e. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:57:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Acquiring lock "cinder-5d60502e-1388-4a65-b874-5a00474c0ca7-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Lock "cinder-5d60502e-1388-4a65-b874-5a00474c0ca7-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Acquiring lock "cinder-quobyte-5d60502e-1388-4a65-b874-5a00474c0ca7" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Lock "cinder-quobyte-5d60502e-1388-4a65-b874-5a00474c0ca7" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ab6f62-b8d6-4279-a69a-13936ba54abe]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:14 devstack sudo[102045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7 Sep 09 16:57:14 devstack sudo[102045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Acquiring lock "cinder-6017cec0-bef9-47b3-ab0b-30f7baf5974c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Lock "cinder-6017cec0-bef9-47b3-ab0b-30f7baf5974c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Acquiring lock "cinder-quobyte-6017cec0-bef9-47b3-ab0b-30f7baf5974c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Lock "cinder-quobyte-6017cec0-bef9-47b3-ab0b-30f7baf5974c" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e372dbd-01ef-4e98-892a-db48e9c726a8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:15 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c Sep 09 16:57:15 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:15 devstack sudo[102045]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7" returned: 0 in 0.734s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:15 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7 Sep 09 16:57:15 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:15 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c" returned: 0 in 0.584s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:15 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c Sep 09 16:57:15 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:16 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5d60502e-1388-4a65-b874-5a00474c0ca7" returned: 0 in 0.540s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Lock "cinder-quobyte-5d60502e-1388-4a65-b874-5a00474c0ca7" released by "delete_volume" :: held 1.361s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Created reservations ['e4f62e7d-54c4-48a3-b59b-b496007d3cf7', '2e883f84-ecde-4732-b11b-a52a093b0b7b', '33b26828-68e3-4ba4-a305-94a6f27e3e68', 'db5d12a1-4d43-4744-87d0-346d0078aa53'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:16 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6017cec0-bef9-47b3-ab0b-30f7baf5974c" returned: 0 in 0.512s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Lock "cinder-quobyte-6017cec0-bef9-47b3-ab0b-30f7baf5974c" released by "delete_volume" :: held 1.162s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:16 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:16 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Created reservations ['f9f46aed-f7fb-4791-9eac-aef25029c313', 'cf4e7002-f0dd-486d-8d39-0d89d5eda21c', '4f6a5a69-c32b-4006-815f-af4e996dbe22', '8992120a-23d0-4dc4-9f0d-a45dc9e7fbba'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:16 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:16 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:16 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Deleted volume successfully. Sep 09 16:57:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-192408aa-5a95-4991-81e6-939ba3c4c41e tempest-VolumesTransfersTest-1283551590 None] Lock "cinder-5d60502e-1388-4a65-b874-5a00474c0ca7-delete_volume" released by "delete_volume" :: held 2.115s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:17 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.598s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Deleted volume successfully. Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0ca0d9-2d03-495f-bb7b-dcea7dcc34db tempest-TestMinimumBasicScenario-1384676336 None] Lock "cinder-6017cec0-bef9-47b3-ab0b-30f7baf5974c-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-7b6f9b1c-009f-4617-9e00-35f681ba4585 tempest-TestShelveInstance-1782761603 None] Terminate volume connection completed successfully. Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-7b6f9b1c-009f-4617-9e00-35f681ba4585 tempest-TestShelveInstance-1782761603 None] Deleting attachment 963df7a5-da2e-45b5-94e8-e513c5bb1ef7. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Acquiring lock "cinder-1c43dcc7-e165-4479-8207-e3fb219cd0f7-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Lock "cinder-1c43dcc7-e165-4479-8207-e3fb219cd0f7-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Flow 'volume_create_manager' (7e9446f7-972f-4c7f-b1b4-5451a94493d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72af9448-cbb6-4eb1-85b4-e6885a2478ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72af9448-cbb6-4eb1-85b4-e6885a2478ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-749665606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc569314-54c7-48c6-b4d4-f728b4d00fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53321fe1a51e49e3aa609c3d60fd162b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:18Z,use_quota=True,user_id='df49bad37be0469898551488f54f19a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df3d5c6-6731-4e76-8c7b-d0486ee70962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9df3d5c6-6731-4e76-8c7b-d0486ee70962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade12968-7c92-4d0b-ae85-184a2df97be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ade12968-7c92-4d0b-ae85-184a2df97be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc569314-54c7-48c6-b4d4-f728b4d00fe1', 'volume_name': 'volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7861b26c-d09f-4470-9cbe-eca6b1fb80b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7861b26c-d09f-4470-9cbe-eca6b1fb80b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd944f8b-9e45-4847-bb82-9138beb4ccb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Volume fc569314-54c7-48c6-b4d4-f728b4d00fe1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1', 'volume_size': 1} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-749665606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc569314-54c7-48c6-b4d4-f728b4d00fe1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53321fe1a51e49e3aa609c3d60fd162b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:18Z,use_quota=True,user_id='df49bad37be0469898551488f54f19a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Creating volume fc569314-54c7-48c6-b4d4-f728b4d00fe1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Acquiring lock "cinder-quobyte-1c43dcc7-e165-4479-8207-e3fb219cd0f7" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Lock "cinder-quobyte-1c43dcc7-e165-4479-8207-e3fb219cd0f7" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:18 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1 1073741824 Sep 09 16:57:18 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a969854-7085-4f4c-a5aa-2d68417deb4f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:18 devstack sudo[102100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 Sep 09 16:57:18 devstack sudo[102100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:18 devstack sudo[102100]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7" returned: 0 in 0.787s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:18 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7 Sep 09 16:57:18 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:19 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1 1073741824" returned: 0 in 0.981s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:19 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1 Sep 09 16:57:19 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:19 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1c43dcc7-e165-4479-8207-e3fb219cd0f7" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Lock "cinder-quobyte-1c43dcc7-e165-4479-8207-e3fb219cd0f7" released by "delete_volume" :: held 1.184s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.quota [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Created reservations ['2fc33ece-304a-4787-a476-a121a0178593', '818df4e9-3492-4f72-a482-98cf424b4b28', 'b3744c05-c2f5-4a7d-8047-1a285fae1c2b', 'd57637ea-5ae6-4fcf-a30d-f8eb57504d9a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:19 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1" returned: 0 in 0.436s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:19 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:19 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd944f8b-9e45-4847-bb82-9138beb4ccb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e19e961-60c1-4aa4-9dac-a3da6003d4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Volume volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1 (fc569314-54c7-48c6-b4d4-f728b4d00fe1): created successfully Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e19e961-60c1-4aa4-9dac-a3da6003d4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Flow 'volume_create_manager' (7e9446f7-972f-4c7f-b1b4-5451a94493d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c95b4d89-baf1-4964-90b3-d2b9e4a16b7a tempest-VolumesTransfersTest-1249896948 None] Created volume successfully. Sep 09 16:57:19 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.manager [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Deleted volume successfully. Sep 09 16:57:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [req-d89bf94f-7074-4b17-84c6-3c2523feb9d8 req-4d68aa16-0644-452d-8413-e42c0f2d0ce4 tempest-TestShelveInstance-1782761603 None] Lock "cinder-1c43dcc7-e165-4479-8207-e3fb219cd0f7-delete_volume" released by "delete_volume" :: held 2.099s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Acquiring lock "cinder-fc569314-54c7-48c6-b4d4-f728b4d00fe1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Lock "cinder-fc569314-54c7-48c6-b4d4-f728b4d00fe1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Acquiring lock "cinder-quobyte-fc569314-54c7-48c6-b4d4-f728b4d00fe1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Lock "cinder-quobyte-fc569314-54c7-48c6-b4d4-f728b4d00fe1" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd39cda-6879-4b75-93ac-329d36739978]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:20 devstack sudo[102139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1 Sep 09 16:57:20 devstack sudo[102139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:20 devstack sudo[102139]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1" returned: 0 in 0.529s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:21 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1 Sep 09 16:57:21 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:21 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fc569314-54c7-48c6-b4d4-f728b4d00fe1" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Lock "cinder-quobyte-fc569314-54c7-48c6-b4d4-f728b4d00fe1" released by "delete_volume" :: held 1.020s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Created reservations ['179c262e-28fe-45f1-a014-8109931f72bf', '4d3ea59e-da1a-4450-8c29-75d848d0c6ae', 'cd9e1a04-97f3-40bd-92a5-71ea44d8dcf0', '791be1f5-96ee-4d78-955e-e4fd06e3ba6d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:21 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:21 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:21 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.257s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Deleted volume successfully. Sep 09 16:57:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-da19792f-7f9b-4d79-b002-512e443999cd tempest-VolumesTransfersTest-1283551590 None] Lock "cinder-fc569314-54c7-48c6-b4d4-f728b4d00fe1-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:31 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=32,cinder:INSERT=10,cinder:UPDATE=45,cinder:DELETE=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:57:31 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=31,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Flow 'volume_create_manager' (2392c739-754d-4c6b-ad02-41a8585837da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597c28fc-856f-4f42-8f50-fc6a483a643a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597c28fc-856f-4f42-8f50-fc6a483a643a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-257861032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349f081b-94ed-44cd-bc0c-e1fa40f224e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77795ad0ce414204b4fba7515b1caf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:38Z,use_quota=True,user_id='a069e94c6662402ba40e74d5b2056484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915dacda-74fa-4f94-80a6-e4a45bb7bd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (915dacda-74fa-4f94-80a6-e4a45bb7bd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2444b9d-8b73-4827-969f-3dbf96411838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2444b9d-8b73-4827-969f-3dbf96411838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '349f081b-94ed-44cd-bc0c-e1fa40f224e7', 'volume_name': 'volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6755a053-811c-4144-8e6c-d25cfa9f1b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6755a053-811c-4144-8e6c-d25cfa9f1b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f3d3b0-d0ea-4bb3-a472-1f34380db575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Volume 349f081b-94ed-44cd-bc0c-e1fa40f224e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7', 'volume_size': 1} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-257861032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=349f081b-94ed-44cd-bc0c-e1fa40f224e7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77795ad0ce414204b4fba7515b1caf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:38Z,use_quota=True,user_id='a069e94c6662402ba40e74d5b2056484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Creating volume 349f081b-94ed-44cd-bc0c-e1fa40f224e7 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:38 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7 1073741824 Sep 09 16:57:38 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:38 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7 1073741824" returned: 0 in 0.528s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:38 devstack sudo[102203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7 Sep 09 16:57:38 devstack sudo[102203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:39 devstack sudo[102203]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f3d3b0-d0ea-4bb3-a472-1f34380db575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13be8d1a-83aa-4b4d-9309-ed65b52e64af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Volume volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7 (349f081b-94ed-44cd-bc0c-e1fa40f224e7): created successfully Sep 09 16:57:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13be8d1a-83aa-4b4d-9309-ed65b52e64af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Flow 'volume_create_manager' (2392c739-754d-4c6b-ad02-41a8585837da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6b7c5d70-bf69-454a-9954-ae4966829e1c tempest-VolumesListTestJSON-1782086891 None] Created volume successfully. Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Flow 'volume_create_manager' (fb39aab6-80f3-4f80-8887-7d8d9ed2a039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e80d44-88e7-4470-9a04-275de4437b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02e80d44-88e7-4470-9a04-275de4437b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1951535620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd101e1-ff30-47f8-b332-a6cc318668dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77795ad0ce414204b4fba7515b1caf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:41Z,use_quota=True,user_id='a069e94c6662402ba40e74d5b2056484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321e08b0-6403-44b8-91df-f6f11e5a1ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (321e08b0-6403-44b8-91df-f6f11e5a1ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf58665-c6f9-4ad1-8a63-7d7fd0597f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf58665-c6f9-4ad1-8a63-7d7fd0597f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bd101e1-ff30-47f8-b332-a6cc318668dd', 'volume_name': 'volume-7bd101e1-ff30-47f8-b332-a6cc318668dd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06774723-e1a9-4f5a-9e0b-554a5674dd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06774723-e1a9-4f5a-9e0b-554a5674dd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef84a05-b9ed-41f8-9d19-3070b9607ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:41 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Volume 7bd101e1-ff30-47f8-b332-a6cc318668dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bd101e1-ff30-47f8-b332-a6cc318668dd', 'volume_size': 1} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1951535620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bd101e1-ff30-47f8-b332-a6cc318668dd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77795ad0ce414204b4fba7515b1caf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:41Z,use_quota=True,user_id='a069e94c6662402ba40e74d5b2056484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Creating volume 7bd101e1-ff30-47f8-b332-a6cc318668dd {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:41 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:41 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd 1073741824 Sep 09 16:57:41 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:41 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd 1073741824" returned: 0 in 0.606s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:41 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd Sep 09 16:57:41 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:42 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef84a05-b9ed-41f8-9d19-3070b9607ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bd101e1-ff30-47f8-b332-a6cc318668dd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347d3a18-6ef1-4f83-a391-72ecd301eb2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Volume volume-7bd101e1-ff30-47f8-b332-a6cc318668dd (7bd101e1-ff30-47f8-b332-a6cc318668dd): created successfully Sep 09 16:57:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347d3a18-6ef1-4f83-a391-72ecd301eb2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Flow 'volume_create_manager' (fb39aab6-80f3-4f80-8887-7d8d9ed2a039) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-84eeaca2-9b45-45ae-a032-391afbc39f0e tempest-VolumesListTestJSON-1782086891 None] Created volume successfully. Sep 09 16:57:43 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Flow 'volume_create_manager' (0459155c-b9e0-4e00-92a3-759710762d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e554e8-d815-42b3-a0f1-7d4d78f78310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e554e8-d815-42b3-a0f1-7d4d78f78310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1578933337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77795ad0ce414204b4fba7515b1caf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:44Z,use_quota=True,user_id='a069e94c6662402ba40e74d5b2056484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09399209-7f18-40d6-b7d6-c1ad8465646a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09399209-7f18-40d6-b7d6-c1ad8465646a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66fe017-62d4-42d2-9bab-96bfb0df81c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f66fe017-62d4-42d2-9bab-96bfb0df81c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0', 'volume_name': 'volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97914ab3-d17b-4ce9-b533-1848337bef6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97914ab3-d17b-4ce9-b533-1848337bef6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a23a710-9e33-4c01-8f13-a42b0775a54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Volume 40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0', 'volume_size': 1} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1578933337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='77795ad0ce414204b4fba7515b1caf90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:44Z,use_quota=True,user_id='a069e94c6662402ba40e74d5b2056484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Creating volume 40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:44 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:44 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 1073741824 Sep 09 16:57:44 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:44 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 1073741824" returned: 0 in 0.629s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:44 devstack sudo[102229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 Sep 09 16:57:44 devstack sudo[102229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (29c03517-b6a1-4f76-94b2-bfa1b0a8e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4038d383-fc4d-4412-b555-8a565d572b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4038d383-fc4d-4412-b555-8a565d572b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-84007286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05307ff-845d-408a-86ca-7b1285df0293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:45Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59864a7a-be7c-40cb-96c8-4646c8f05693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack sudo[102229]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59864a7a-be7c-40cb-96c8-4646c8f05693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c590d20-89c3-4648-94b6-64f10b9b2c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c590d20-89c3-4648-94b6-64f10b9b2c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a05307ff-845d-408a-86ca-7b1285df0293', 'volume_name': 'volume-a05307ff-845d-408a-86ca-7b1285df0293', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4976fd8a-5e5b-4966-aa95-f90da22410c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4976fd8a-5e5b-4966-aa95-f90da22410c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5c6e89-ae61-4e1c-8e8d-9e743268c6b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume a05307ff-845d-408a-86ca-7b1285df0293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a05307ff-845d-408a-86ca-7b1285df0293', 'volume_size': 1} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] <== create_volume: return (1114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.033s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-84007286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a05307ff-845d-408a-86ca-7b1285df0293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:45Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Creating volume a05307ff-845d-408a-86ca-7b1285df0293 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:45 devstack sudo[102232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:45 devstack sudo[102232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:45 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a23a710-9e33-4c01-8f13-a42b0775a54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:45 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293 1073741824 Sep 09 16:57:45 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dcd98e-00eb-421e-9cf3-e572d83cf0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Volume volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 (40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0): created successfully Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42dcd98e-00eb-421e-9cf3-e572d83cf0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Flow 'volume_create_manager' (0459155c-b9e0-4e00-92a3-759710762d3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-81541fba-124f-499d-bdcf-1368bfce218d tempest-VolumesListTestJSON-1782086891 None] Created volume successfully. Sep 09 16:57:45 devstack sudo[102232]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.367s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Flow 'volume_create_manager' (be421fc4-614b-49e9-b46c-3f614957fb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7400f2c-30aa-4371-8f26-c881cda87500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7400f2c-30aa-4371-8f26-c881cda87500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1066478328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adcfded-d088-4ee8-bd66-c1c3f403e2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cfdf61daad4fb197596152b14f2050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:46Z,use_quota=True,user_id='4dac6c2586a84f78b92ca224776c9c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38b44adf-dbdc-473e-bee1-8d7ba68a9fae),volume_type_id=38b44adf-dbdc-473e-bee1-8d7ba68a9fae)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38eb66fe-e28f-4cf5-9fd8-293c3bb7f477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38eb66fe-e28f-4cf5-9fd8-293c3bb7f477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5954da7-69c9-49c2-842f-5b708289567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5954da7-69c9-49c2-842f-5b708289567b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4adcfded-d088-4ee8-bd66-c1c3f403e2c3', 'volume_name': 'volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b483e97a-65d9-4c93-99d3-841538c64c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b483e97a-65d9-4c93-99d3-841538c64c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80d6650-324c-4b74-a5ce-ecedadd1026a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Volume 4adcfded-d088-4ee8-bd66-c1c3f403e2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3', 'volume_size': 1} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:45 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293 1073741824" returned: 0 in 0.624s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:45 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293 Sep 09 16:57:45 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:46 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Flow 'volume_create_manager' (49cea75f-3e8e-49b4-91ea-fe23e5f710dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa42c660-79ae-40f4-976c-d03b4f6365ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.427s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1066478328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4adcfded-d088-4ee8-bd66-c1c3f403e2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cfdf61daad4fb197596152b14f2050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:46Z,use_quota=True,user_id='4dac6c2586a84f78b92ca224776c9c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(38b44adf-dbdc-473e-bee1-8d7ba68a9fae),volume_type_id=38b44adf-dbdc-473e-bee1-8d7ba68a9fae)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Creating volume 4adcfded-d088-4ee8-bd66-c1c3f403e2c3 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:46 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:46 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3 1073741824 Sep 09 16:57:46 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5c6e89-ae61-4e1c-8e8d-9e743268c6b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a05307ff-845d-408a-86ca-7b1285df0293', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea0d4e5-fde2-4c55-aae5-247b84eccc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa42c660-79ae-40f4-976c-d03b4f6365ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-869266180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e0982c-38f5-4684-bf05-de55adc6bd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cfdf61daad4fb197596152b14f2050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:46Z,use_quota=True,user_id='4dac6c2586a84f78b92ca224776c9c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4637281c-224d-4418-bce4-da27defb856c),volume_type_id=4637281c-224d-4418-bce4-da27defb856c)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a06c2cd-58b5-4a87-9de6-b282fe72e1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a06c2cd-58b5-4a87-9de6-b282fe72e1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dae9e28-c183-465c-93e8-0f07aa5aa515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dae9e28-c183-465c-93e8-0f07aa5aa515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e0982c-38f5-4684-bf05-de55adc6bd9d', 'volume_name': 'volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746b2d48-2c46-4c91-b60e-fa9f935b310d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (746b2d48-2c46-4c91-b60e-fa9f935b310d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97191fd6-8bac-41b9-b3f8-7a3dfe8656a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Volume f9e0982c-38f5-4684-bf05-de55adc6bd9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d', 'volume_size': 1} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume volume-a05307ff-845d-408a-86ca-7b1285df0293 (a05307ff-845d-408a-86ca-7b1285df0293): created successfully Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ea0d4e5-fde2-4c55-aae5-247b84eccc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (29c03517-b6a1-4f76-94b2-bfa1b0a8e61e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-71d11a00-9082-45b0-b527-3cdfaca2f305 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created volume successfully. Sep 09 16:57:46 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3 1073741824" returned: 0 in 0.660s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:46 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3 Sep 09 16:57:46 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:46 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Flow 'volume_create_manager' (7dbc0348-4496-465a-bc56-4886d05e1377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d45ee4-0103-4e6f-a580-5bf83b6e9cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d45ee4-0103-4e6f-a580-5bf83b6e9cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-401941205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e03f8ec-9078-4f90-8fe7-91f300e711cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cfdf61daad4fb197596152b14f2050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:47Z,use_quota=True,user_id='4dac6c2586a84f78b92ca224776c9c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(896e05a0-6301-4bd1-b7d9-0d413df5bfe2),volume_type_id=896e05a0-6301-4bd1-b7d9-0d413df5bfe2)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e4da0b-8fc3-4867-a9a3-79596ac930fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02e4da0b-8fc3-4867-a9a3-79596ac930fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdce7691-cdd2-4bd3-a4f3-e9ead83d9623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 16:57:47 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.845s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-869266180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e0982c-38f5-4684-bf05-de55adc6bd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cfdf61daad4fb197596152b14f2050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:46Z,use_quota=True,user_id='4dac6c2586a84f78b92ca224776c9c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4637281c-224d-4418-bce4-da27defb856c),volume_type_id=4637281c-224d-4418-bce4-da27defb856c)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Creating volume f9e0982c-38f5-4684-bf05-de55adc6bd9d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b80d6650-324c-4b74-a5ce-ecedadd1026a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bc8f34-9ef0-43e0-ad46-3ed00277fed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:47 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d 1073741824 Sep 09 16:57:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Volume volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3 (4adcfded-d088-4ee8-bd66-c1c3f403e2c3): created successfully Sep 09 16:57:47 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bc8f34-9ef0-43e0-ad46-3ed00277fed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Flow 'volume_create_manager' (be421fc4-614b-49e9-b46c-3f614957fb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5047f8ba-f69c-49f7-b084-c31606d84805 tempest-TestInstancesWithCinderVolumes-24597606 None] Created volume successfully. Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdce7691-cdd2-4bd3-a4f3-e9ead83d9623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2e03f8ec-9078-4f90-8fe7-91f300e711cf', 'volume_name': 'volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf', 'volume_size': 1, 'image_id': '7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1882505822', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46cfdf61daad4fb197596152b14f2050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'created_at': datetime.datetime(2026, 9, 9, 14, 57, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 57, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f9ab54a-4a41-4673-a56e-d9c1a0e982f6/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c1eb62-63db-458c-b31b-7517c5464cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12c1eb62-63db-458c-b31b-7517c5464cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed1e04a-a9ad-4171-a66a-f8ba254d808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Volume 2e03f8ec-9078-4f90-8fe7-91f300e711cf: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf', 'volume_size': 1, 'image_id': '7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1882505822', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46cfdf61daad4fb197596152b14f2050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'created_at': datetime.datetime(2026, 9, 9, 14, 57, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 57, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f9ab54a-4a41-4673-a56e-d9c1a0e982f6/file', 'properties': {}}, 'image_service': } Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Trying to clone 2e03f8ec-9078-4f90-8fe7-91f300e711cf from image 7f9ab54a-4a41-4673-a56e-d9c1a0e982f6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 16:57:47 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d 1073741824" returned: 0 in 0.728s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (dfa66432-fbf3-44ad-b40f-3f74bb9c5d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c423fc1-c0a6-4aee-a789-37fa35e42015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c423fc1-c0a6-4aee-a789-37fa35e42015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-754004502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e7ad24-cc8a-4d6c-9f75-0c959b555794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:48Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb7a37d-7402-4337-9498-26c3b7e31d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cb7a37d-7402-4337-9498-26c3b7e31d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b881f26-186c-42ce-9e16-2314c3a00df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b881f26-186c-42ce-9e16-2314c3a00df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58e7ad24-cc8a-4d6c-9f75-0c959b555794', 'volume_name': 'volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166f535f-404d-4d36-8d28-2cc024cc9995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166f535f-404d-4d36-8d28-2cc024cc9995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a027283-f6d4-4c32-8131-39055fcc4cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume 58e7ad24-cc8a-4d6c-9f75-0c959b555794: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794', 'volume_size': 1} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:48 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d Sep 09 16:57:48 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (26ffb752-fe31-45f0-92bf-8ef740e66ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f61b006-6c36-4456-842d-9e8d907ee5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f61b006-6c36-4456-842d-9e8d907ee5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1929949207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35187a7-e0db-46be-9417-07400ea121c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:48Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbc93c0-ab01-484c-9839-7e3fd90cdbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fbc93c0-ab01-484c-9839-7e3fd90cdbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d37f376-84ea-4e81-8d80-c2ba3da85a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d37f376-84ea-4e81-8d80-c2ba3da85a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c35187a7-e0db-46be-9417-07400ea121c2', 'volume_name': 'volume-c35187a7-e0db-46be-9417-07400ea121c2', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c54748-6fb0-43ff-a654-2c355ef28255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8c54748-6fb0-43ff-a654-2c355ef28255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430a5595-52d2-4f0c-b583-af5f51b628ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume c35187a7-e0db-46be-9417-07400ea121c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c35187a7-e0db-46be-9417-07400ea121c2', 'volume_size': 1} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d" returned: 0 in 0.535s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.583s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-754004502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58e7ad24-cc8a-4d6c-9f75-0c959b555794,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:48Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Creating volume 58e7ad24-cc8a-4d6c-9f75-0c959b555794 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:48 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:48 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794 1073741824 Sep 09 16:57:48 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97191fd6-8bac-41b9-b3f8-7a3dfe8656a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42786b4c-ab4f-48c6-b7d5-99a81e1a1882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:48 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Volume volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d (f9e0982c-38f5-4684-bf05-de55adc6bd9d): created successfully Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42786b4c-ab4f-48c6-b7d5-99a81e1a1882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:48 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Flow 'volume_create_manager' (49cea75f-3e8e-49b4-91ea-fe23e5f710dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-54e9413a-ad99-442a-8a0d-6c554c415161 tempest-TestInstancesWithCinderVolumes-24597606 None] Created volume successfully. Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (c77ae839-f2d2-4193-ac46-8b9651476e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4766f3-e445-4b1d-9d98-ea673f14ae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f4766f3-e445-4b1d-9d98-ea673f14ae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1238567863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8034ac-0487-4239-b2ce-2e1a1afc954f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:49Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f28950-b0bd-4f68-96e5-5eed9bdb5b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56f28950-b0bd-4f68-96e5-5eed9bdb5b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edafcb5-e8d8-4831-97a1-51a4f3e78eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edafcb5-e8d8-4831-97a1-51a4f3e78eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e8034ac-0487-4239-b2ce-2e1a1afc954f', 'volume_name': 'volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b86038c-5bbb-4a23-8fdc-6737fb2a765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b86038c-5bbb-4a23-8fdc-6737fb2a765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1da4bc-e2dd-4f3c-aaa5-b8516a18c653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume 6e8034ac-0487-4239-b2ce-2e1a1afc954f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f', 'volume_size': 1} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "cinder-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "cinder-quobyte-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-quobyte-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:49 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794 1073741824" returned: 0 in 0.832s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cca437-7d62-4744-bb12-fe7f9146b94e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:49 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794 Sep 09 16:57:49 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (11a04955-8853-4458-bff4-23df2db96e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6545607-6ff7-4f72-9964-589b538be1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:49 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 Sep 09 16:57:49 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6545607-6ff7-4f72-9964-589b538be1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1962030339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd00fb95-6427-4cfa-94e5-380d1f82131f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:50Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb0e696-1abd-4518-9281-bd1bb6a530e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efb0e696-1abd-4518-9281-bd1bb6a530e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f45384c-0865-421e-ae31-bb229d87fd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f45384c-0865-421e-ae31-bb229d87fd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd00fb95-6427-4cfa-94e5-380d1f82131f', 'volume_name': 'volume-bd00fb95-6427-4cfa-94e5-380d1f82131f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50939b6b-ad90-4416-be89-bb9bdfec99fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50939b6b-ad90-4416-be89-bb9bdfec99fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fda0b8e-4661-47d8-b5c2-a9c266fe31f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume bd00fb95-6427-4cfa-94e5-380d1f82131f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd00fb95-6427-4cfa-94e5-380d1f82131f', 'volume_size': 1} Sep 09 16:57:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:50 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794" returned: 0 in 0.454s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] <== create_volume: return (1410ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.434s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:50 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1929949207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c35187a7-e0db-46be-9417-07400ea121c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:48Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Creating volume c35187a7-e0db-46be-9417-07400ea121c2 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0" returned: 0 in 0.600s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:50 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2 1073741824 Sep 09 16:57:50 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a027283-f6d4-4c32-8131-39055fcc4cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:50 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0 Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998ea4b6-e165-47b1-988b-bbc2e1947bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:50 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794 (58e7ad24-cc8a-4d6c-9f75-0c959b555794): created successfully Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998ea4b6-e165-47b1-988b-bbc2e1947bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (dfa66432-fbf3-44ad-b40f-3f74bb9c5d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5a57a648-fef2-4c4b-9b30-9811c6391f7b tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created volume successfully. Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (d31ec31e-e2c8-4ac6-b33a-a6e7a6daa69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7da76be-becc-483e-9510-4914f705138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:50 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7da76be-becc-483e-9510-4914f705138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864241248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253f5b8a-0ed4-4e3a-95c7-98f0b2387053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:50Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34deb1c1-b207-46a0-bf1d-7e27a4b244b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34deb1c1-b207-46a0-bf1d-7e27a4b244b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d6fe04-4898-4e84-909a-28130df38fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d6fe04-4898-4e84-909a-28130df38fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253f5b8a-0ed4-4e3a-95c7-98f0b2387053', 'volume_name': 'volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d004f9b-87c4-4612-9926-ff26d3dc8843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d004f9b-87c4-4612-9926-ff26d3dc8843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa40101-a48a-4807-8f54-acfb0cc600c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume 253f5b8a-0ed4-4e3a-95c7-98f0b2387053: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053', 'volume_size': 1} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0" returned: 0 in 0.452s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-quobyte-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0" released by "delete_volume" :: held 1.122s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Flow 'volume_create_manager' (37a02e42-9133-4f04-8307-fa57b669770a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1faa48c2-d4e3-4505-95e9-eb33ec199265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1faa48c2-d4e3-4505-95e9-eb33ec199265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc2e5d5-f889-4599-b503-ac2472e21502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae77882fe6c4e0eacd5c49bef86b0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:51Z,use_quota=True,user_id='e56eee9d760549afa7a7d54e0fd715ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01be03c6-1eef-4228-9946-bef1d053c4c4),volume_type_id=01be03c6-1eef-4228-9946-bef1d053c4c4)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7706d2ec-4f88-4595-8427-ff0488db07e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7706d2ec-4f88-4595-8427-ff0488db07e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7770e0a-989f-4fdd-b87f-16197cfceabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Created reservations ['be23c47e-b579-4516-b3b8-f08a36b39aaa', 'b22a4c6d-f69e-4cea-a238-e4251ff1607c', '837f1b9e-39f8-407f-9e3a-4493706d1dd8', '49aebf0f-cffe-4f58-adba-bbc2c3bfbdf4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:50 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2 1073741824" returned: 0 in 0.628s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:50 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2 Sep 09 16:57:50 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:50 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:50 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7770e0a-989f-4fdd-b87f-16197cfceabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3fc2e5d5-f889-4599-b503-ac2472e21502', 'volume_name': 'volume-3fc2e5d5-f889-4599-b503-ac2472e21502', 'volume_size': 1, 'image_id': '13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '427050628c120a04fad50b6bcd43ad69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fae77882fe6c4e0eacd5c49bef86b0ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba41f17e5b39fdbef390e15e5753968089c1c11a609d96468e23af60e604e34c77a7a1bcd48380447d0844c2182f8d12c09142467f210ca2ab4b6c5af4e73311', 'id': '13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'created_at': datetime.datetime(2026, 9, 9, 14, 57, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 57, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13bf4a7c-0be9-4a12-960b-3a50b7895f0a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c592281-39e4-4d72-9bf9-10acaade05bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c592281-39e4-4d72-9bf9-10acaade05bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69cbf69-4af1-4475-b67a-4899cb0ea1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Volume 3fc2e5d5-f889-4599-b503-ac2472e21502: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3fc2e5d5-f889-4599-b503-ac2472e21502', 'volume_size': 1, 'image_id': '13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '427050628c120a04fad50b6bcd43ad69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fae77882fe6c4e0eacd5c49bef86b0ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba41f17e5b39fdbef390e15e5753968089c1c11a609d96468e23af60e604e34c77a7a1bcd48380447d0844c2182f8d12c09142467f210ca2ab4b6c5af4e73311', 'id': '13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'created_at': datetime.datetime(2026, 9, 9, 14, 57, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 57, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13bf4a7c-0be9-4a12-960b-3a50b7895f0a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Trying to clone 3fc2e5d5-f889-4599-b503-ac2472e21502 from image 13bf4a7c-0be9-4a12-960b-3a50b7895f0a at location (None, [{'url': 'file:///opt/stack/data/glance/images/13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 16:57:51 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.759s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1238567863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e8034ac-0487-4239-b2ce-2e1a1afc954f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:49Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Creating volume 6e8034ac-0487-4239-b2ce-2e1a1afc954f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:51 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 16:57:51 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Image download 0.00 MB at 0.00 MB/s Sep 09 16:57:51 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f 1073741824 Sep 09 16:57:51 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (430a5595-52d2-4f0c-b583-af5f51b628ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c35187a7-e0db-46be-9417-07400ea121c2', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5512d84e-fc5b-4700-9d49-efab366c3c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume volume-c35187a7-e0db-46be-9417-07400ea121c2 (c35187a7-e0db-46be-9417-07400ea121c2): created successfully Sep 09 16:57:51 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5512d84e-fc5b-4700-9d49-efab366c3c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (26ffb752-fe31-45f0-92bf-8ef740e66ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ee1277-a909-47fa-a4cd-219c137f8890]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Deleted volume successfully. Sep 09 16:57:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-53d80e6b-fa1a-47ee-9621-f5c2d7a48606 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created volume successfully. Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-50998af6-4bc6-4119-8268-3abb88b3599c tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-40baf4f9-2f9d-4a44-8fd9-72d7f7f95be0-delete_volume" released by "delete_volume" :: held 1.911s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:51 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD Sep 09 16:57:51 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:51 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:51 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f 1073741824" returned: 0 in 0.589s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "cinder-7bd101e1-ff30-47f8-b332-a6cc318668dd-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:51 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f Sep 09 16:57:51 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:51 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-7bd101e1-ff30-47f8-b332-a6cc318668dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:51 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "cinder-quobyte-7bd101e1-ff30-47f8-b332-a6cc318668dd" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-quobyte-7bd101e1-ff30-47f8-b332-a6cc318668dd" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f604eb9-c2e6-433f-8aa5-666e49682356]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:52 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd Sep 09 16:57:52 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:52 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD" returned: 1 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Temporary image 13bf4a7c-0be9-4a12-960b-3a50b7895f0a is fetched for user e56eee9d760549afa7a7d54e0fd715ca. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 16:57:52 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.232s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1962030339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd00fb95-6427-4cfa-94e5-380d1f82131f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:50Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Creating volume bd00fb95-6427-4cfa-94e5-380d1f82131f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:52 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:52 devstack sudo[102312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f 1073741824 Sep 09 16:57:52 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e1da4bc-e2dd-4f3c-aaa5-b8516a18c653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f92b47-2ebf-4ded-b8e7-a49557111df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f (6e8034ac-0487-4239-b2ce-2e1a1afc954f): created successfully Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55f92b47-2ebf-4ded-b8e7-a49557111df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (c77ae839-f2d2-4193-ac46-8b9651476e84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-caaf3ca1-533d-4b9f-b05a-79031d9c5660 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created volume successfully. Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab12b7e-f6fc-40ad-bb8d-37ebb7af260d]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:52 devstack sudo[102314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD Sep 09 16:57:52 devstack sudo[102314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:52 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd" returned: 0 in 0.441s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:52 devstack sudo[102322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd Sep 09 16:57:52 devstack sudo[102322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:52 devstack sudo[102314]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD" returned: 0 in 0.491s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:52 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f 1073741824" returned: 0 in 0.605s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:52 devstack sudo[102322]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7bd101e1-ff30-47f8-b332-a6cc318668dd" returned: 0 in 0.395s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-quobyte-7bd101e1-ff30-47f8-b332-a6cc318668dd" released by "delete_volume" :: held 0.884s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:52 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f Sep 09 16:57:52 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:52 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD Sep 09 16:57:52 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Created reservations ['785e8577-0964-4d57-b320-8cd04d9d9b6d', '0df69ce4-3dac-4ad2-a8fb-fb7c2265957a', 'ec1f4a4d-c289-4151-b9f1-6b7558db5251', '66794461-973e-4347-9b15-a6032ec2dd55'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:52 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:52 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:53 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.423s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-864241248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253f5b8a-0ed4-4e3a-95c7-98f0b2387053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='225dbded72db4e25821c3680d0890e91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:50Z,use_quota=True,user_id='de68b689ad114c34ba192bfd15062e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Creating volume 253f5b8a-0ed4-4e3a-95c7-98f0b2387053 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:53 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:53 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "cinder-349f081b-94ed-44cd-bc0c-e1fa40f224e7-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD" returned: 1 in 0.420s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:53 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053 1073741824 Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fda0b8e-4661-47d8-b5c2-a9c266fe31f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd00fb95-6427-4cfa-94e5-380d1f82131f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:53 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbba2533-80c4-47ac-9447-38f9e5799bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-349f081b-94ed-44cd-bc0c-e1fa40f224e7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume volume-bd00fb95-6427-4cfa-94e5-380d1f82131f (bd00fb95-6427-4cfa-94e5-380d1f82131f): created successfully Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbba2533-80c4-47ac-9447-38f9e5799bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (11a04955-8853-4458-bff4-23df2db96e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2a4e5a8f-d13b-49f4-9099-6100f985ee42 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created volume successfully. Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "cinder-quobyte-349f081b-94ed-44cd-bc0c-e1fa40f224e7" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-quobyte-349f081b-94ed-44cd-bc0c-e1fa40f224e7" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fa37f7-47c6-4979-b098-cafad1a033c0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:53 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Deleted volume successfully. Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37ff740b-ae8c-4950-ab2e-ba514a8224d1 tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-7bd101e1-ff30-47f8-b332-a6cc318668dd-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:53 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7 Sep 09 16:57:53 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:53 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:53 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053 1073741824" returned: 0 in 0.654s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:53 devstack sudo[102350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7 Sep 09 16:57:53 devstack sudo[102350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:53 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053 Sep 09 16:57:53 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:53 devstack sudo[102350]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-349f081b-94ed-44cd-bc0c-e1fa40f224e7" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-quobyte-349f081b-94ed-44cd-bc0c-e1fa40f224e7" released by "delete_volume" :: held 0.764s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:54 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.918s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fc2e5d5-f889-4599-b503-ac2472e21502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fae77882fe6c4e0eacd5c49bef86b0ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:51Z,use_quota=True,user_id='e56eee9d760549afa7a7d54e0fd715ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01be03c6-1eef-4228-9946-bef1d053c4c4),volume_type_id=01be03c6-1eef-4228-9946-bef1d053c4c4)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Creating volume 3fc2e5d5-f889-4599-b503-ac2472e21502 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:54 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:54 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 1073741824 Sep 09 16:57:54 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa40101-a48a-4807-8f54-acfb0cc600c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5fcea8-e72e-42f9-808b-ba8d81c15424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Created reservations ['55ceffe3-6c93-4162-acfe-c679abe56707', '5fea6f2a-6c3a-47d5-a0fc-1437e3dcf239', 'fdfccc5a-51c8-46c9-9e98-0af351a0d5fc', 'dbb94d0a-11a5-44e9-8404-412afb4d073e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Volume volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053 (253f5b8a-0ed4-4e3a-95c7-98f0b2387053): created successfully Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b5fcea8-e72e-42f9-808b-ba8d81c15424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Flow 'volume_create_manager' (d31ec31e-e2c8-4ac6-b33a-a6e7a6daa69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6127a9af-18ee-42da-8855-a585c95f3df8 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created volume successfully. Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:54 devstack sudo[102358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:54 devstack sudo[102358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:54 devstack sudo[102358]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:54 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Deleted volume successfully. Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 1073741824" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-85986e3f-23b6-4458-81df-455c0f35c96b tempest-VolumesListTestJSON-1782086891 None] Lock "cinder-349f081b-94ed-44cd-bc0c-e1fa40f224e7-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:54 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 Sep 09 16:57:54 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD, size 20.69 MB, duration 7.34 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 16:57:54 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Image download 20.69 MB at 2.82 MB/s Sep 09 16:57:54 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e2b3e9-3e7a-42b4-8d4a-b4952852910c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-253f5b8a-0ed4-4e3a-95c7-98f0b2387053-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Attempting download of 13bf4a7c-0be9-4a12-960b-3a50b7895f0a ((None, [{'url': 'file:///opt/stack/data/glance/images/13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'metadata': {}}])) to volume 3fc2e5d5-f889-4599-b503-ac2472e21502. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1197}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-253f5b8a-0ed4-4e3a-95c7-98f0b2387053-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-quobyte-253f5b8a-0ed4-4e3a-95c7-98f0b2387053" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[08636d4e-9922-46e1-ad55-a4a0d8068bbd]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_hwvxvo5g {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:55 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD Sep 09 16:57:55 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-253f5b8a-0ed4-4e3a-95c7-98f0b2387053" acquired by "delete_volume" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06f5b5c-aa6f-41f2-bba4-8c61170cffc1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:55 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_hwvxvo5g Sep 09 16:57:55 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:55 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053 Sep 09 16:57:55 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:55 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD" returned: 0 in 0.496s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Temporary image 7f9ab54a-4a41-4673-a56e-d9c1a0e982f6 is fetched for user 4dac6c2586a84f78b92ca224776c9c7d. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 16:57:55 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_hwvxvo5g" returned: 0 in 0.437s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_hwvxvo5g {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a39623b-a7bf-4698-8564-006a35911bd9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:55 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053" returned: 0 in 0.441s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:55 devstack sudo[102386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053 Sep 09 16:57:55 devstack sudo[102386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:55 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_hwvxvo5g Sep 09 16:57:55 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:55 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD Sep 09 16:57:55 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:55 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:57:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-401941205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e03f8ec-9078-4f90-8fe7-91f300e711cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46cfdf61daad4fb197596152b14f2050',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:57:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:57:47Z,use_quota=True,user_id='4dac6c2586a84f78b92ca224776c9c7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(896e05a0-6301-4bd1-b7d9-0d413df5bfe2),volume_type_id=896e05a0-6301-4bd1-b7d9-0d413df5bfe2)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Creating volume 2e03f8ec-9078-4f90-8fe7-91f300e711cf {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:55 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:56 devstack sudo[102386]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:57:56 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_hwvxvo5g" returned: 1 in 0.469s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_hwvxvo5g' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-253f5b8a-0ed4-4e3a-95c7-98f0b2387053" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b87995-336e-463e-8167-f828dd72b2ab]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:56 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf 1073741824 Sep 09 16:57:56 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-253f5b8a-0ed4-4e3a-95c7-98f0b2387053" released by "delete_volume" :: held 0.910s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created reservations ['08076830-eb3f-4f86-896c-e6d449663777', 'cb1563eb-f2b9-4e8b-ae97-f3dd45aebd4d', '3c3cb2c2-c1be-4a5f-bc6f-264419196347', 'eabba07c-4a75-4423-b79a-c7b5f4f1c7ad'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:56 devstack sudo[102398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD Sep 09 16:57:56 devstack sudo[102398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:56 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:56 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:56 devstack sudo[102398]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:56 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf 1073741824" returned: 0 in 0.533s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:56 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Deleted volume successfully. Sep 09 16:57:56 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD Sep 09 16:57:56 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf Sep 09 16:57:56 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:56 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-90a9a885-9c2f-4b7a-9e13-28ad9ddc3e13 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-253f5b8a-0ed4-4e3a-95c7-98f0b2387053-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:56 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD" returned: 1 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] 13bf4a7c-0be9-4a12-960b-3a50b7895f0a was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:56 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:56 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 Sep 09 16:57:56 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Attempting download of 7f9ab54a-4a41-4673-a56e-d9c1a0e982f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'metadata': {}}])) to volume 2e03f8ec-9078-4f90-8fe7-91f300e711cf. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1197}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68722d1-543a-4422-b56b-74bb69e206cd]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_k8p9b36l {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:57 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_k8p9b36l Sep 09 16:57:57 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-bd00fb95-6427-4cfa-94e5-380d1f82131f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-bd00fb95-6427-4cfa-94e5-380d1f82131f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-quobyte-bd00fb95-6427-4cfa-94e5-380d1f82131f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-bd00fb95-6427-4cfa-94e5-380d1f82131f" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:57 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_k8p9b36l" returned: 0 in 0.396s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_k8p9b36l {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d37419-9134-4a61-9b1b-cff2def8e166]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:57 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502" returned: 0 in 0.612s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_13bf4a7c-0be9-4a12-960b-3a50b7895f0a_ay3_2zm3devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:57:57 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:57 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_k8p9b36l Sep 09 16:57:57 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:57 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 1G Sep 09 16:57:57 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:57 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f Sep 09 16:57:57 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:57 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_k8p9b36l" returned: 1 in 0.387s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_k8p9b36l' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde5a69-25f5-4f85-a075-3858a1de78fa]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:57 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f" returned: 0 in 0.453s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:57 devstack sudo[102442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f Sep 09 16:57:57 devstack sudo[102442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:57 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD Sep 09 16:57:57 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:57 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 1G" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Downloaded image 13bf4a7c-0be9-4a12-960b-3a50b7895f0a ((None, [{'url': 'file:///opt/stack/data/glance/images/13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'metadata': {}}])) to volume 3fc2e5d5-f889-4599-b503-ac2472e21502 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1242}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Temporary image 13bf4a7c-0be9-4a12-960b-3a50b7895f0a for user e56eee9d760549afa7a7d54e0fd715ca is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Marking volume 3fc2e5d5-f889-4599-b503-ac2472e21502 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1146}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Copying metadata from image 13bf4a7c-0be9-4a12-960b-3a50b7895f0a to 3fc2e5d5-f889-4599-b503-ac2472e21502. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 16:57:57 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Creating volume glance metadata for volume 3fc2e5d5-f889-4599-b503-ac2472e21502 backed by image 13bf4a7c-0be9-4a12-960b-3a50b7895f0a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '427050628c120a04fad50b6bcd43ad69', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69cbf69-4af1-4475-b67a-4899cb0ea1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fc2e5d5-f889-4599-b503-ac2472e21502', 'volume_size': 1, 'image_id': '13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '427050628c120a04fad50b6bcd43ad69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fae77882fe6c4e0eacd5c49bef86b0ee', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ba41f17e5b39fdbef390e15e5753968089c1c11a609d96468e23af60e604e34c77a7a1bcd48380447d0844c2182f8d12c09142467f210ca2ab4b6c5af4e73311', 'id': '13bf4a7c-0be9-4a12-960b-3a50b7895f0a', 'created_at': datetime.datetime(2026, 9, 9, 14, 57, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 57, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/13bf4a7c-0be9-4a12-960b-3a50b7895f0a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f56764c-2877-4321-b302-6185d32a9a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:57:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Volume volume-3fc2e5d5-f889-4599-b503-ac2472e21502 (3fc2e5d5-f889-4599-b503-ac2472e21502): created successfully Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f56764c-2877-4321-b302-6185d32a9a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Flow 'volume_create_manager' (37a02e42-9133-4f04-8307-fa57b669770a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:57:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7a7091bb-83c0-494c-9408-c5629f9290fb tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Created volume successfully. Sep 09 16:57:58 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] 7f9ab54a-4a41-4673-a56e-d9c1a0e982f6 was qcow2, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:58 devstack sudo[102442]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bd00fb95-6427-4cfa-94e5-380d1f82131f" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-bd00fb95-6427-4cfa-94e5-380d1f82131f" released by "delete_volume" :: held 0.850s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:58 devstack sudo[102449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf Sep 09 16:57:58 devstack sudo[102449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created reservations ['0b32b6f0-49c6-4ca4-8343-449fc4a12749', 'a30e0700-d14c-4467-ac96-1f139a9d3a71', 'd749d40b-55c2-426e-b094-80dc8149beb5', 'ac648145-b760-4fc1-91d1-79c45ea595a8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:58 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:58 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-6e8034ac-0487-4239-b2ce-2e1a1afc954f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-6e8034ac-0487-4239-b2ce-2e1a1afc954f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-quobyte-6e8034ac-0487-4239-b2ce-2e1a1afc954f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-6e8034ac-0487-4239-b2ce-2e1a1afc954f" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[90482542-fdd6-48d3-89f4-527a88481bb4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:58 devstack sudo[102456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f Sep 09 16:57:58 devstack sudo[102456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:58 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.410s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:57:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Deleted volume successfully. Sep 09 16:57:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6b03fe47-8ecd-4ba7-970a-af19a5daac0a tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-bd00fb95-6427-4cfa-94e5-380d1f82131f-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:59 devstack sudo[102456]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f" returned: 0 in 0.508s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Acquiring lock "cinder-3fc2e5d5-f889-4599-b503-ac2472e21502-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:59 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f Sep 09 16:57:59 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Lock "cinder-3fc2e5d5-f889-4599-b503-ac2472e21502-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Acquiring lock "cinder-quobyte-3fc2e5d5-f889-4599-b503-ac2472e21502" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Lock "cinder-quobyte-3fc2e5d5-f889-4599-b503-ac2472e21502" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[341539dd-33af-48bb-b44f-fdbf17591b18]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:59 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6e8034ac-0487-4239-b2ce-2e1a1afc954f" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-6e8034ac-0487-4239-b2ce-2e1a1afc954f" released by "delete_volume" :: held 0.945s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:57:59 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 Sep 09 16:57:59 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created reservations ['5f83c7d4-0c10-474c-b792-02631da727b5', '523445ba-a877-484c-a380-35a28151f423', 'f21ca036-afb0-4e3c-ac02-9c37020f2b70', '791be844-55f4-4418-815a-b9b7aad2f675'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:59 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:57:59 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:57:59 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502" returned: 0 in 0.549s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:57:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:57:59 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502 Sep 09 16:57:59 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:00 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.293s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Deleted volume successfully. Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36635a84-d6c4-4557-afa9-b8058a7ab580 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-6e8034ac-0487-4239-b2ce-2e1a1afc954f-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:00 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3fc2e5d5-f889-4599-b503-ac2472e21502" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Lock "cinder-quobyte-3fc2e5d5-f889-4599-b503-ac2472e21502" released by "delete_volume" :: held 0.917s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:00 devstack cinder-volume[87498]: WARNING cinder.quota [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:58:00 devstack cinder-volume[87498]: WARNING cinder.quota [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Created reservations ['10162a87-cb1c-4725-ab06-16c5368dbad3', '89fcbbf2-9bef-47c5-b288-eb44c4f05c89', '6c4835b7-0da3-428a-bfe9-43f8e0cd43bb', 'b320a2ff-3e75-40ab-bfb9-aef8bfdd46fc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:00 devstack sudo[102487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:00 devstack sudo[102487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:00 devstack sudo[102449]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf" returned: 0 in 2.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f9ab54a-4a41-4673-a56e-d9c1a0e982f6_e9ida04xdevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:58:00 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Converted 112.00 MB image at 48.38 MB/s Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:00 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf 1G Sep 09 16:58:00 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:00 devstack sudo[102487]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Deleted volume successfully. Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed547498-0bcf-46ec-bf3d-967b43835a82 tempest-VolumeAndVolumeTypeFromImageTest-1792718411 None] Lock "cinder-3fc2e5d5-f889-4599-b503-ac2472e21502-delete_volume" released by "delete_volume" :: held 1.519s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-c35187a7-e0db-46be-9417-07400ea121c2-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-c35187a7-e0db-46be-9417-07400ea121c2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-quobyte-c35187a7-e0db-46be-9417-07400ea121c2" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-c35187a7-e0db-46be-9417-07400ea121c2" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffd87a0-2c08-4f55-99ef-761a791eadb7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:00 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf 1G" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Downloaded image 7f9ab54a-4a41-4673-a56e-d9c1a0e982f6 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'metadata': {}}])) to volume 2e03f8ec-9078-4f90-8fe7-91f300e711cf successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1242}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Temporary image 7f9ab54a-4a41-4673-a56e-d9c1a0e982f6 for user 4dac6c2586a84f78b92ca224776c9c7d is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Marking volume 2e03f8ec-9078-4f90-8fe7-91f300e711cf as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1146}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Copying metadata from image 7f9ab54a-4a41-4673-a56e-d9c1a0e982f6 to 2e03f8ec-9078-4f90-8fe7-91f300e711cf. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 16:58:00 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Creating volume glance metadata for volume 2e03f8ec-9078-4f90-8fe7-91f300e711cf backed by image 7f9ab54a-4a41-4673-a56e-d9c1a0e982f6 with: {'image_id': '7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'image_name': 'tempest-scenario-img--1882505822', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 16:58:00 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2 Sep 09 16:58:00 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ed1e04a-a9ad-4171-a66a-f8ba254d808d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf', 'volume_size': 1, 'image_id': '7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1882505822', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '46cfdf61daad4fb197596152b14f2050', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '7f9ab54a-4a41-4673-a56e-d9c1a0e982f6', 'created_at': datetime.datetime(2026, 9, 9, 14, 57, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 14, 57, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f9ab54a-4a41-4673-a56e-d9c1a0e982f6/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03e68b4-9420-41a8-ac81-436213e5cdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Volume volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf (2e03f8ec-9078-4f90-8fe7-91f300e711cf): created successfully Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03e68b4-9420-41a8-ac81-436213e5cdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Flow 'volume_create_manager' (7dbc0348-4496-465a-bc56-4886d05e1377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-efda3b6f-069d-4860-a93a-abc4fd1a0ae3 tempest-TestInstancesWithCinderVolumes-24597606 None] Created volume successfully. Sep 09 16:58:01 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2" returned: 0 in 0.427s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:01 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2 Sep 09 16:58:01 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:01 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c35187a7-e0db-46be-9417-07400ea121c2" returned: 0 in 0.319s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-c35187a7-e0db-46be-9417-07400ea121c2" released by "delete_volume" :: held 0.793s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created reservations ['04c6bdb3-56a3-49a3-a027-57daf7a7f790', '2f053127-d294-46c9-a0f1-d1343727584f', '76777bd9-ef51-4415-937f-afbe7da93c68', 'b17e81d2-aa07-4b0c-8d1d-df1082668450'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:01 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:01 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-58e7ad24-cc8a-4d6c-9f75-0c959b555794-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-58e7ad24-cc8a-4d6c-9f75-0c959b555794-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-quobyte-58e7ad24-cc8a-4d6c-9f75-0c959b555794" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-58e7ad24-cc8a-4d6c-9f75-0c959b555794" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9877a5-7d6a-4194-a698-478a40559cca]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:02 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.428s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Deleted volume successfully. Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e77af6-5e22-466a-a485-eafd88bc1c75 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-c35187a7-e0db-46be-9417-07400ea121c2-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:02 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794 Sep 09 16:58:02 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:02 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794" returned: 0 in 0.531s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:02 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794 Sep 09 16:58:02 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:03 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-58e7ad24-cc8a-4d6c-9f75-0c959b555794" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-58e7ad24-cc8a-4d6c-9f75-0c959b555794" released by "delete_volume" :: held 0.937s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created reservations ['3801f024-e295-4d2f-b072-3a2daa7941cf', '6ce179d6-70cc-43e8-a95f-d54776bbdc1a', '799bf57e-1e1a-4410-976e-9d7dd48e4a08', 'a067945d-1edb-44ab-858c-9c7c2a993f22'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:03 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:03 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:03 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Deleted volume successfully. Sep 09 16:58:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e12a7f60-d88f-4be8-a1e6-e1a250d5e613 tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-58e7ad24-cc8a-4d6c-9f75-0c959b555794-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-a05307ff-845d-408a-86ca-7b1285df0293-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-a05307ff-845d-408a-86ca-7b1285df0293-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "cinder-quobyte-a05307ff-845d-408a-86ca-7b1285df0293" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-a05307ff-845d-408a-86ca-7b1285df0293" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:04 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f21dee5-be3e-48dc-96a2-d0261d54ef84]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:04 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293 Sep 09 16:58:04 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-cd1e2f60-a2d5-4e07-829a-dfe11947279d req-85368e3e-5c60-4d9c-827c-2f4b6dd77d1f tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-cd1e2f60-a2d5-4e07-829a-dfe11947279d req-85368e3e-5c60-4d9c-827c-2f4b6dd77d1f tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-cd1e2f60-a2d5-4e07-829a-dfe11947279d req-85368e3e-5c60-4d9c-827c-2f4b6dd77d1f tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-cd1e2f60-a2d5-4e07-829a-dfe11947279d req-85368e3e-5c60-4d9c-827c-2f4b6dd77d1f tempest-TestInstancesWithCinderVolumes-24597606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b13a202f-bef6-4082-b31d-e45251c589c4', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:58:05 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293" returned: 0 in 0.655s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:05 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293 Sep 09 16:58:05 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-cd1e2f60-a2d5-4e07-829a-dfe11947279d req-85368e3e-5c60-4d9c-827c-2f4b6dd77d1f tempest-TestInstancesWithCinderVolumes-24597606 None] attachment_update completed successfully. Sep 09 16:58:05 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a05307ff-845d-408a-86ca-7b1285df0293" returned: 0 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-quobyte-a05307ff-845d-408a-86ca-7b1285df0293" released by "delete_volume" :: held 1.040s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Created reservations ['120f1339-48e8-4acc-8891-090bc7f584ba', '3c27ad2a-2a24-46e2-b154-66cbe1ab9841', 'f2f76f3d-a50a-4ed0-9c7a-23281dd5629d', 'efa4500f-cdaf-4dd6-ad26-7aecb69bf87d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:05 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:05 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:06 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.314s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Deleted volume successfully. Sep 09 16:58:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a0e6499e-663e-4ef2-b53f-6aae38f96eff tempest-CreateVolumesFromSourceVolumeTest-1622489686 None] Lock "cinder-a05307ff-845d-408a-86ca-7b1285df0293-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Flow 'volume_create_manager' (57ccd723-d7b0-479c-ae44-bdf57c44bc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c07dd6-7232-4b6c-99a7-f98f61a7b552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c07dd6-7232-4b6c-99a7-f98f61a7b552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666874693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc14e0c5-bd9f-4165-a9e0-3be1982c6628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cef39213e64fe08a4bad12b4ad89d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:10Z,use_quota=True,user_id='00264eef34eb468e9655acdd79f2f577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e656c82-e0f2-494f-afe3-517449b09519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e656c82-e0f2-494f-afe3-517449b09519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef767d63-5764-4d9c-bfa3-34821dc2b625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef767d63-5764-4d9c-bfa3-34821dc2b625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc14e0c5-bd9f-4165-a9e0-3be1982c6628', 'volume_name': 'volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256aa797-b603-494c-887a-8065447c6a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256aa797-b603-494c-887a-8065447c6a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a546b5f9-3f1a-4767-8663-0c485315ea42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:09 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Volume bc14e0c5-bd9f-4165-a9e0-3be1982c6628: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628', 'volume_size': 1} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-666874693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc14e0c5-bd9f-4165-a9e0-3be1982c6628,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cef39213e64fe08a4bad12b4ad89d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:10Z,use_quota=True,user_id='00264eef34eb468e9655acdd79f2f577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Creating volume bc14e0c5-bd9f-4165-a9e0-3be1982c6628 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:09 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:58:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:09 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628 1073741824 Sep 09 16:58:09 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:10 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628 1073741824" returned: 0 in 0.842s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:10 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628 Sep 09 16:58:10 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:11 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628" returned: 0 in 0.475s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:58:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a546b5f9-3f1a-4767-8663-0c485315ea42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee4ee13-8837-408f-a0d7-b43e8595c897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Volume volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628 (bc14e0c5-bd9f-4165-a9e0-3be1982c6628): created successfully Sep 09 16:58:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ee4ee13-8837-408f-a0d7-b43e8595c897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Flow 'volume_create_manager' (57ccd723-d7b0-479c-ae44-bdf57c44bc31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f3de5dbc-ef99-4405-ba89-28d9f04fb2ba tempest-ProjectReaderTests-1753216006 None] Created volume successfully. Sep 09 16:58:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Acquiring lock "cinder-bc14e0c5-bd9f-4165-a9e0-3be1982c6628-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Lock "cinder-bc14e0c5-bd9f-4165-a9e0-3be1982c6628-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Acquiring lock "cinder-quobyte-bc14e0c5-bd9f-4165-a9e0-3be1982c6628" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Lock "cinder-quobyte-bc14e0c5-bd9f-4165-a9e0-3be1982c6628" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c13f54-9952-407b-9367-c9404aaf6730]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:12 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628 Sep 09 16:58:12 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:13 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628" returned: 0 in 0.573s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:13 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628 Sep 09 16:58:13 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:13 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bc14e0c5-bd9f-4165-a9e0-3be1982c6628" returned: 0 in 0.407s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Lock "cinder-quobyte-bc14e0c5-bd9f-4165-a9e0-3be1982c6628" released by "delete_volume" :: held 1.036s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Created reservations ['cad529fe-3c77-4b74-88c9-290e7721c2c1', '3b1ae9af-163b-4cb5-8f62-f54e1ca217e5', '5b0f0b85-7b89-4ace-8a8f-260f87f7627c', '4260afbb-e58c-4a08-a010-546f021190df'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:13 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:13 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:14 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Deleted volume successfully. Sep 09 16:58:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-392d7a65-fc0f-4702-bd51-2612ce571df3 tempest-ProjectReaderTests-1753216006 None] Lock "cinder-bc14e0c5-bd9f-4165-a9e0-3be1982c6628-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Flow 'volume_create_manager' (8a60d0b5-ddfa-44bb-a2ac-75363a36957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404bb628-d900-45aa-b81d-a7e8e9d5d89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404bb628-d900-45aa-b81d-a7e8e9d5d89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182577558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63af5a2-310f-4e81-bf65-ab3903d3500e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cef39213e64fe08a4bad12b4ad89d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:15Z,use_quota=True,user_id='00264eef34eb468e9655acdd79f2f577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0550766-2ff1-49f0-8bda-7918e6d2c074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0550766-2ff1-49f0-8bda-7918e6d2c074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf6b586-875e-4782-9103-afe3e4757f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcf6b586-875e-4782-9103-afe3e4757f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e63af5a2-310f-4e81-bf65-ab3903d3500e', 'volume_name': 'volume-e63af5a2-310f-4e81-bf65-ab3903d3500e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6326b8d-0548-42e7-9d91-5a8d39c006b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6326b8d-0548-42e7-9d91-5a8d39c006b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd9cae0-1bc0-44a8-8606-7831590ce39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Volume e63af5a2-310f-4e81-bf65-ab3903d3500e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e63af5a2-310f-4e81-bf65-ab3903d3500e', 'volume_size': 1} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1182577558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e63af5a2-310f-4e81-bf65-ab3903d3500e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02cef39213e64fe08a4bad12b4ad89d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:15Z,use_quota=True,user_id='00264eef34eb468e9655acdd79f2f577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Creating volume e63af5a2-310f-4e81-bf65-ab3903d3500e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:58:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:15 devstack sudo[103011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e 1073741824 Sep 09 16:58:15 devstack sudo[103011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:16 devstack sudo[103011]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e 1073741824" returned: 0 in 0.719s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:16 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e Sep 09 16:58:16 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:16 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e" returned: 0 in 0.409s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:58:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dd9cae0-1bc0-44a8-8606-7831590ce39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e63af5a2-310f-4e81-bf65-ab3903d3500e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45171aa0-2651-4a38-8e6f-217e1c465d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Volume volume-e63af5a2-310f-4e81-bf65-ab3903d3500e (e63af5a2-310f-4e81-bf65-ab3903d3500e): created successfully Sep 09 16:58:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45171aa0-2651-4a38-8e6f-217e1c465d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Flow 'volume_create_manager' (8a60d0b5-ddfa-44bb-a2ac-75363a36957a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2f5346c9-1f9d-4fea-85c4-d5a408f084d2 tempest-ProjectReaderTests-1753216006 None] Created volume successfully. Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Flow 'volume_create_manager' (877d23fc-c62b-48d5-a93a-3a34cede5a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64621d4-65cf-40ba-b271-9e1db3a590e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64621d4-65cf-40ba-b271-9e1db3a590e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-736290955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320468a0-04c0-4cb8-aa9b-0ff2158282d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e59bef83db4dc8b326114e3ed0c2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:17Z,use_quota=True,user_id='daf4137791954427a75e3bbf63f70601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f58f81f-7c8a-4d2a-840d-2c47add5ddeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f58f81f-7c8a-4d2a-840d-2c47add5ddeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2d5aa6-6dac-4099-bc59-0a46c46f20b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2d5aa6-6dac-4099-bc59-0a46c46f20b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '320468a0-04c0-4cb8-aa9b-0ff2158282d5', 'volume_name': 'volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e4e931-f554-4834-bfb4-fdc5db4caace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3e4e931-f554-4834-bfb4-fdc5db4caace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7bdf9c-3d42-4797-a1e2-62d9a44264a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Volume 320468a0-04c0-4cb8-aa9b-0ff2158282d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5', 'volume_size': 1} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-736290955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=320468a0-04c0-4cb8-aa9b-0ff2158282d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e59bef83db4dc8b326114e3ed0c2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:17Z,use_quota=True,user_id='daf4137791954427a75e3bbf63f70601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Creating volume 320468a0-04c0-4cb8-aa9b-0ff2158282d5 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:17 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:17 devstack sudo[103022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 1073741824 Sep 09 16:58:17 devstack sudo[103022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Acquiring lock "cinder-e63af5a2-310f-4e81-bf65-ab3903d3500e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Lock "cinder-e63af5a2-310f-4e81-bf65-ab3903d3500e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Acquiring lock "cinder-quobyte-e63af5a2-310f-4e81-bf65-ab3903d3500e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Lock "cinder-quobyte-e63af5a2-310f-4e81-bf65-ab3903d3500e" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c8c6a5-1f31-4bc7-8c5a-2ca8b5c9b379]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:18 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e Sep 09 16:58:18 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:18 devstack sudo[103022]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 1073741824" returned: 0 in 0.617s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:18 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 Sep 09 16:58:18 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:18 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e" returned: 0 in 0.594s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:18 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e Sep 09 16:58:18 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:18 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7bdf9c-3d42-4797-a1e2-62d9a44264a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277ec29c-d91c-4cca-a72d-5af122cc1fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Volume volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 (320468a0-04c0-4cb8-aa9b-0ff2158282d5): created successfully Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277ec29c-d91c-4cca-a72d-5af122cc1fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Flow 'volume_create_manager' (877d23fc-c62b-48d5-a93a-3a34cede5a9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a186c0ec-80af-4747-a973-5bc2423b5cf8 tempest-VolumesSnapshotTestJSON-77225072 None] Created volume successfully. Sep 09 16:58:18 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e63af5a2-310f-4e81-bf65-ab3903d3500e" returned: 0 in 0.332s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Lock "cinder-quobyte-e63af5a2-310f-4e81-bf65-ab3903d3500e" released by "delete_volume" :: held 0.979s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:18 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Created reservations ['107b181f-1949-4c73-b6d8-de9a3187beb8', 'c42c20ef-e90d-4c10-b03e-7ea01ef875e6', '15570610-838e-49eb-a93f-13d48bc2e6c3', '20a0e352-f09a-4488-a1d0-1042f57c61be'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:19 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:19 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:19 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:19 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Deleted volume successfully. Sep 09 16:58:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd6aac25-eb37-446d-80bb-bc4f8a924d60 tempest-ProjectReaderTests-1753216006 None] Lock "cinder-e63af5a2-310f-4e81-bf65-ab3903d3500e-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Creating offline snapshot 669a2633-4905-4b79-ac8f-0f547e41e064 of volume 320468a0-04c0-4cb8-aa9b-0ff2158282d5 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:58:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d4d54e-371b-4cac-a0ea-20c8e4c0938d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:20 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 Sep 09 16:58:20 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:20 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5" returned: 0 in 0.677s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:20 devstack sudo[103049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 1G Sep 09 16:58:20 devstack sudo[103049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:21 devstack sudo[103049]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 1G" returned: 0 in 0.689s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:21 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 Sep 09 16:58:21 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:22 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064" returned: 0 in 0.506s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:22 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 is being set with open permissions: ugo+rw Sep 09 16:58:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:22 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 Sep 09 16:58:22 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:22 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064" returned: 0 in 0.460s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:22 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.info Sep 09 16:58:22 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:22 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.info" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:22 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.info is being set with open permissions: ugo+rw Sep 09 16:58:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:22 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.info Sep 09 16:58:22 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:23 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.info" returned: 0 in 0.324s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.087s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ca845dae-a440-4073-a3f3-bee690fa92b6 tempest-VolumesSnapshotTestJSON-77225072 None] Create snapshot completed successfully Sep 09 16:58:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-669a2633-4905-4b79-ac8f-0f547e41e064-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-669a2633-4905-4b79-ac8f-0f547e41e064-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-320468a0-04c0-4cb8-aa9b-0ff2158282d5" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-320468a0-04c0-4cb8-aa9b-0ff2158282d5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-669a2633-4905-4b79-ac8f-0f547e41e064" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-669a2633-4905-4b79-ac8f-0f547e41e064" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Deleting offline snapshot 669a2633-4905-4b79-ac8f-0f547e41e064 of volume 320468a0-04c0-4cb8-aa9b-0ff2158282d5 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:58:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] snapshot_file for this snap is: volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:58:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a390288-9d39-4f11-866b-d6e3d3864e23]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:24 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 Sep 09 16:58:24 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:25 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064" returned: 0 in 0.473s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:58:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1935a4-f3ea-485d-bce8-91bdccde4234]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:25 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 Sep 09 16:58:25 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:25 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:25 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 Sep 09 16:58:25 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:26 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064" returned: 0 in 0.355s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:26 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064 Sep 09 16:58:26 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:26 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5.669a2633-4905-4b79-ac8f-0f547e41e064" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-669a2633-4905-4b79-ac8f-0f547e41e064" released by "_delete_snapshot" :: held 1.708s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-320468a0-04c0-4cb8-aa9b-0ff2158282d5" released by "delete_snapshot" :: held 1.748s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Created reservations ['0d42be12-271d-4821-b8f3-5da419ead0e3', '42fd5e76-9ac2-4db4-b7bb-0832e30efec7', '6b4746af-3f62-4a35-b1be-046f46e0075e', 'dd035d63-00e8-475e-b213-d489c7930e7c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Delete snapshot completed successfully. Sep 09 16:58:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31bbf9e2-48eb-4fae-94f3-27085c99c3f3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-669a2633-4905-4b79-ac8f-0f547e41e064-delete_snapshot" released by "delete_snapshot" :: held 2.028s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Flow 'volume_create_manager' (6f6df452-280d-466c-8f59-23085379d7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d452b4ef-c6dc-4e2d-ac46-2b6f86866373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d452b4ef-c6dc-4e2d-ac46-2b6f86866373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1933042353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0974bafe-94b1-488e-a75a-a6f609caad75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e59bef83db4dc8b326114e3ed0c2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:27Z,use_quota=True,user_id='daf4137791954427a75e3bbf63f70601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfd5756-1ff6-4021-bb25-8a6df98f5918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cfd5756-1ff6-4021-bb25-8a6df98f5918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa93732-2c41-44be-b605-7e18005d1a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfa93732-2c41-44be-b605-7e18005d1a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0974bafe-94b1-488e-a75a-a6f609caad75', 'volume_name': 'volume-0974bafe-94b1-488e-a75a-a6f609caad75', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef9ef5f-3d1a-4eab-bad7-f21bb0361fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef9ef5f-3d1a-4eab-bad7-f21bb0361fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780c6e4c-d17f-4ed0-928e-af74f4c2fafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Volume 0974bafe-94b1-488e-a75a-a6f609caad75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0974bafe-94b1-488e-a75a-a6f609caad75', 'volume_size': 1} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1933042353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0974bafe-94b1-488e-a75a-a6f609caad75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e59bef83db4dc8b326114e3ed0c2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:27Z,use_quota=True,user_id='daf4137791954427a75e3bbf63f70601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Creating volume 0974bafe-94b1-488e-a75a-a6f609caad75 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:27 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:58:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:27 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 1073741824 Sep 09 16:58:27 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:28 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 1073741824" returned: 0 in 0.529s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:28 devstack sudo[103135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 Sep 09 16:58:28 devstack sudo[103135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:28 devstack sudo[103135]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:58:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780c6e4c-d17f-4ed0-928e-af74f4c2fafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0974bafe-94b1-488e-a75a-a6f609caad75', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9256dcee-677f-474f-8860-e1125588cb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Volume volume-0974bafe-94b1-488e-a75a-a6f609caad75 (0974bafe-94b1-488e-a75a-a6f609caad75): created successfully Sep 09 16:58:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9256dcee-677f-474f-8860-e1125588cb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Flow 'volume_create_manager' (6f6df452-280d-466c-8f59-23085379d7a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c21bca48-d786-4358-9b13-986c47eeea30 tempest-VolumesSnapshotTestJSON-77225072 None] Created volume successfully. Sep 09 16:58:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Creating offline snapshot cc779100-2ac9-4147-806c-fe7cd2fb81bd of volume 0974bafe-94b1-488e-a75a-a6f609caad75 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:58:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d7499e-75e8-40ec-bbc9-aad161513110]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:29 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 Sep 09 16:58:29 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:30 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75" returned: 0 in 0.394s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:30 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd 1G Sep 09 16:58:30 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Flow 'volume_create_manager' (3b2a5158-87bd-4e29-8aee-a7e2d34043d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c464e9cf-e086-4c9a-8948-bcac72b9b281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c464e9cf-e086-4c9a-8948-bcac72b9b281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420839736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ded809-38b5-42aa-bcf9-48bedee40d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6b533c8246414a86bb61d383a02f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:30Z,use_quota=True,user_id='f507ba118ac944adb7311082eb8ce42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd23608e-72e8-4e9e-be85-9b608d12b5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd23608e-72e8-4e9e-be85-9b608d12b5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4715a07f-a301-46e7-8818-6f3b609aec55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4715a07f-a301-46e7-8818-6f3b609aec55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84ded809-38b5-42aa-bcf9-48bedee40d5b', 'volume_name': 'volume-84ded809-38b5-42aa-bcf9-48bedee40d5b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db412c6-5fdb-4a62-a438-470911e2f666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db412c6-5fdb-4a62-a438-470911e2f666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1a7107-f414-465b-bc6f-5ed031601dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Volume 84ded809-38b5-42aa-bcf9-48bedee40d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84ded809-38b5-42aa-bcf9-48bedee40d5b', 'volume_size': 1} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:30 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd 1G" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0974bafe-94b1-488e-a75a-a6f609caad75 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:30 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0974bafe-94b1-488e-a75a-a6f609caad75 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd Sep 09 16:58:30 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:30 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0974bafe-94b1-488e-a75a-a6f609caad75 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:30 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd is being set with open permissions: ugo+rw Sep 09 16:58:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:30 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd Sep 09 16:58:30 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:31 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:31 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.info Sep 09 16:58:31 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:31 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.info" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:31 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.info is being set with open permissions: ugo+rw Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:31 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.info Sep 09 16:58:31 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:31 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.info" returned: 0 in 0.230s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.121s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1420839736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84ded809-38b5-42aa-bcf9-48bedee40d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6b533c8246414a86bb61d383a02f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:30Z,use_quota=True,user_id='f507ba118ac944adb7311082eb8ce42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Creating volume 84ded809-38b5-42aa-bcf9-48bedee40d5b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:31 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:31 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b 1073741824 Sep 09 16:58:31 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:31 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=125,cinder:INSERT=43,cinder:UPDATE=174,cinder:DELETE=15 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:58:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fbdb2516-7cf1-4083-bc83-3c80232f2706 tempest-VolumesSnapshotTestJSON-77225072 None] Create snapshot completed successfully Sep 09 16:58:32 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b 1073741824" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=149,cinder:SELECT=140,cinder:DELETE=16,cinder:INSERT=47 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:32 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b Sep 09 16:58:32 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:32 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb1a7107-f414-465b-bc6f-5ed031601dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84ded809-38b5-42aa-bcf9-48bedee40d5b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca7b973-eb7a-4a24-9623-bbcc047ec9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Volume volume-84ded809-38b5-42aa-bcf9-48bedee40d5b (84ded809-38b5-42aa-bcf9-48bedee40d5b): created successfully Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca7b973-eb7a-4a24-9623-bbcc047ec9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Flow 'volume_create_manager' (3b2a5158-87bd-4e29-8aee-a7e2d34043d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Flow 'volume_create_manager' (03cb3d0d-46c3-4537-ae43-ee211f500641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41aecfcf-4bee-4eb1-87a2-a579bfe7138a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-459bc962-4cd6-432f-8947-71d0f7eb0e0f tempest-ProjectReaderTests-1914591138 None] Created volume successfully. Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41aecfcf-4bee-4eb1-87a2-a579bfe7138a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-533233584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e7a67ab-e386-444e-b3d5-1fffb4e9db48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e59bef83db4dc8b326114e3ed0c2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=cc779100-2ac9-4147-806c-fe7cd2fb81bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:32Z,use_quota=True,user_id='daf4137791954427a75e3bbf63f70601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a742137f-c673-49fe-bb43-4682cc057244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a742137f-c673-49fe-bb43-4682cc057244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800e9cbb-3ae5-4724-985d-f799dfe8d405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800e9cbb-3ae5-4724-985d-f799dfe8d405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0e7a67ab-e386-444e-b3d5-1fffb4e9db48', 'volume_name': 'volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48', 'volume_size': 2, 'snapshot_id': 'cc779100-2ac9-4147-806c-fe7cd2fb81bd'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d0b1d4-572b-47fe-95c4-a4b82876025d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d0b1d4-572b-47fe-95c4-a4b82876025d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c2858b-1767-4df9-a62f-d2df21933ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Volume 0e7a67ab-e386-444e-b3d5-1fffb4e9db48: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48', 'volume_size': 2, 'snapshot_id': 'cc779100-2ac9-4147-806c-fe7cd2fb81bd'} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-cc779100-2ac9-4147-806c-fe7cd2fb81bd-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-cc779100-2ac9-4147-806c-fe7cd2fb81bd-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Creating volume 0e7a67ab-e386-444e-b3d5-1fffb4e9db48 from snapshot cc779100-2ac9-4147-806c-fe7cd2fb81bd {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] snapshot: cc779100-2ac9-4147-806c-fe7cd2fb81bd, volume: 0e7a67ab-e386-444e-b3d5-1fffb4e9db48, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[01062b1b-621f-4854-aa3f-ee8a3b90924b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:32 devstack sudo[103212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd Sep 09 16:58:32 devstack sudo[103212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:33 devstack sudo[103212]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd" returned: 0 in 0.367s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0974bafe-94b1-488e-a75a-a6f609caad75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6d5644-26a5-4e5f-a372-a04b840a8359]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:33 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 Sep 09 16:58:33 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:33 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:33 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 Sep 09 16:58:33 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "cinder-84ded809-38b5-42aa-bcf9-48bedee40d5b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-84ded809-38b5-42aa-bcf9-48bedee40d5b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "cinder-quobyte-84ded809-38b5-42aa-bcf9-48bedee40d5b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-quobyte-84ded809-38b5-42aa-bcf9-48bedee40d5b" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbf93de-4b57-44a4-86dc-fa2f12b34bdf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:34 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b Sep 09 16:58:34 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:34 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b" returned: 0 in 0.658s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:34 devstack sudo[103240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b Sep 09 16:58:34 devstack sudo[103240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:35 devstack sudo[103240]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-84ded809-38b5-42aa-bcf9-48bedee40d5b" returned: 0 in 0.729s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-quobyte-84ded809-38b5-42aa-bcf9-48bedee40d5b" released by "delete_volume" :: held 1.453s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:35 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Created reservations ['a1302044-d9da-4dae-bc15-f6fed66e9b5a', 'd5ddb703-842e-4245-9196-c7070daef5b2', '31d61b7f-e75c-468f-9370-e70c3be2fb94', '6942462d-6228-47c3-97d6-936c0d293f42'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:35 devstack sudo[103246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:35 devstack sudo[103246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:36 devstack sudo[103246]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.515s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Deleted volume successfully. Sep 09 16:58:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-399ae62c-df38-4016-ae70-45c7bb1c51c4 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-84ded809-38b5-42aa-bcf9-48bedee40d5b-delete_volume" released by "delete_volume" :: held 2.451s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Flow 'volume_create_manager' (9a91f31a-b10f-4588-9d6f-7808efd7372f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd69115c-929b-49ac-bf82-774b52e7f8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd69115c-929b-49ac-bf82-774b52e7f8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-589152439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6b533c8246414a86bb61d383a02f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:38Z,use_quota=True,user_id='f507ba118ac944adb7311082eb8ce42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fef9cc6-f8ff-4c55-bc2d-e422e85037a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fef9cc6-f8ff-4c55-bc2d-e422e85037a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43dc274c-2c9e-420d-8fbb-4509248823c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43dc274c-2c9e-420d-8fbb-4509248823c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f', 'volume_name': 'volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56dd2b86-cad2-4f7e-a39f-da502a1f9869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56dd2b86-cad2-4f7e-a39f-da502a1f9869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1403aea-f046-4147-965b-2bdcde17288b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Volume 8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f', 'volume_size': 1} Sep 09 16:58:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:38 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" returned: 0 in 4.933s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:58:38 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Converted 1024.00 MB image at 207.53 MB/s Sep 09 16:58:38 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 is being set with open permissions: ugo+rw Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:38 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 Sep 09 16:58:38 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:38 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" released by "_copy_volume_from_snapshot" :: held 5.999s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-cc779100-2ac9-4147-806c-fe7cd2fb81bd-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" released by "_create_volume_from_snapshot" :: held 6.058s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.073s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.849s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-589152439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6b533c8246414a86bb61d383a02f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:38Z,use_quota=True,user_id='f507ba118ac944adb7311082eb8ce42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Creating volume 8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:38 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f 1073741824 Sep 09 16:58:38 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55c2858b-1767-4df9-a62f-d2df21933ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48', 'volume_size': 2, 'snapshot_id': 'cc779100-2ac9-4147-806c-fe7cd2fb81bd'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304363e0-fb1d-4e33-8018-68935a40ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Volume volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 (0e7a67ab-e386-444e-b3d5-1fffb4e9db48): created successfully Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (304363e0-fb1d-4e33-8018-68935a40ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Flow 'volume_create_manager' (03cb3d0d-46c3-4537-ae43-ee211f500641) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9956f990-e59b-4f2f-9de8-921ec03a2e36 tempest-VolumesSnapshotTestJSON-77225072 None] Created volume successfully. Sep 09 16:58:39 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f 1073741824" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:39 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f Sep 09 16:58:39 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-0e7a67ab-e386-444e-b3d5-1fffb4e9db48-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:39 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1403aea-f046-4147-965b-2bdcde17288b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b84bafa-0ce5-41cf-bf0b-cd5f64db63a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-0e7a67ab-e386-444e-b3d5-1fffb4e9db48-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Volume volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f (8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f): created successfully Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b84bafa-0ce5-41cf-bf0b-cd5f64db63a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Flow 'volume_create_manager' (9a91f31a-b10f-4588-9d6f-7808efd7372f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2ed0f9ba-c633-4db0-802e-2c9228141f4b tempest-ProjectReaderTests-1914591138 None] Created volume successfully. Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[82acf8a5-2de7-4a26-a1e4-d6f31bb6fe9b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:39 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 Sep 09 16:58:39 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:39 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:39 devstack sudo[103273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48 Sep 09 16:58:39 devstack sudo[103273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:40 devstack sudo[103273]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-0e7a67ab-e386-444e-b3d5-1fffb4e9db48" released by "delete_volume" :: held 0.653s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Created reservations ['ca30e233-a07d-4a03-88ac-0eac0235e343', 'a90b1bcb-bd00-47de-a862-bc03403ef884', '36264182-36f0-4f84-ac48-7029100197b3', '6f77db09-40b4-454d-a42c-4a4b44258685'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:40 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:40 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:40 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Deleted volume successfully. Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-cc779100-2ac9-4147-806c-fe7cd2fb81bd-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-cc779100-2ac9-4147-806c-fe7cd2fb81bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-0974bafe-94b1-488e-a75a-a6f609caad75" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-144d2c64-45b4-4ca9-a27f-465ae1b7be22 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-0e7a67ab-e386-444e-b3d5-1fffb4e9db48-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "cinder-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-0974bafe-94b1-488e-a75a-a6f609caad75" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-cc779100-2ac9-4147-806c-fe7cd2fb81bd" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-cc779100-2ac9-4147-806c-fe7cd2fb81bd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Deleting offline snapshot cc779100-2ac9-4147-806c-fe7cd2fb81bd of volume 0974bafe-94b1-488e-a75a-a6f609caad75 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] snapshot_file for this snap is: volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c373c925-bcb5-4691-ba6d-03962d3bb232]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "cinder-quobyte-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-quobyte-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa94f77-12c2-4c58-a12b-27da5d391859]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:40 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd Sep 09 16:58:40 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:40 devstack sudo[103280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f Sep 09 16:58:40 devstack sudo[103280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:41 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0974bafe-94b1-488e-a75a-a6f609caad75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2967dc2b-6371-4cf8-89c6-b3b375be89cc]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:41 devstack sudo[103280]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f" returned: 0 in 0.386s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:41 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f Sep 09 16:58:41 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:41 devstack sudo[103286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 Sep 09 16:58:41 devstack sudo[103286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:41 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-quobyte-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f" released by "delete_volume" :: held 0.677s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Created reservations ['a8cd1bbe-9c5f-4544-a621-966ea9e32f5d', '407443f8-d047-4095-8ef9-ae93901846f2', '82febfc9-0adb-45e6-85fd-0f1b20fca022', 'cb791560-80bb-459a-83fb-66ff725ef214'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:41 devstack sudo[103302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:41 devstack sudo[103302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:41 devstack sudo[103286]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75" returned: 0 in 0.541s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:41 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd Sep 09 16:58:41 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:41 devstack sudo[103302]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Deleted volume successfully. Sep 09 16:58:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed749e91-5e55-429c-a094-830c77b1bf44 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-8b37c8b2-fac4-4c19-9a6c-b82fd37aa57f-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:42 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:42 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd Sep 09 16:58:42 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:42 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75.cc779100-2ac9-4147-806c-fe7cd2fb81bd" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-cc779100-2ac9-4147-806c-fe7cd2fb81bd" released by "_delete_snapshot" :: held 1.593s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-0974bafe-94b1-488e-a75a-a6f609caad75" released by "delete_snapshot" :: held 1.624s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Flow 'volume_create_manager' (3838b250-b280-46e7-a673-1f00440ab17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5f8827-4f2c-413a-82fc-4abb7453a059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b5f8827-4f2c-413a-82fc-4abb7453a059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-751735028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb3e026-7c88-4179-a57f-2bbabf73dda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6b533c8246414a86bb61d383a02f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:42Z,use_quota=True,user_id='f507ba118ac944adb7311082eb8ce42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0ce3c7-0b85-45b8-99f9-0ea31a57d363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0ce3c7-0b85-45b8-99f9-0ea31a57d363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc81ea69-55c1-431d-94d4-5328e4d733c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc81ea69-55c1-431d-94d4-5328e4d733c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb3e026-7c88-4179-a57f-2bbabf73dda7', 'volume_name': 'volume-edb3e026-7c88-4179-a57f-2bbabf73dda7', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f46d8c-37af-43b1-809f-662b68294456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36f46d8c-37af-43b1-809f-662b68294456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148e1aa9-4e4f-499d-adb8-9168e7a30919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Volume edb3e026-7c88-4179-a57f-2bbabf73dda7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb3e026-7c88-4179-a57f-2bbabf73dda7', 'volume_size': 1} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-751735028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb3e026-7c88-4179-a57f-2bbabf73dda7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6b533c8246414a86bb61d383a02f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:42Z,use_quota=True,user_id='f507ba118ac944adb7311082eb8ce42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Creating volume edb3e026-7c88-4179-a57f-2bbabf73dda7 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:42 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:42 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7 1073741824 Sep 09 16:58:42 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Created reservations ['b22a5838-66da-4ad4-acdc-39e17726b2ee', 'fe0893a3-55e3-40d9-8c9b-810009ac3933', 'db62af8f-fd70-422c-a55f-038351ceb8a5', '99ffd4eb-a349-4533-9c99-10ca0e250ad6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Delete snapshot completed successfully. Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-bbf6c44b-46e0-4995-8062-5db468453198 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-cc779100-2ac9-4147-806c-fe7cd2fb81bd-delete_snapshot" released by "delete_snapshot" :: held 1.889s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:42 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7 1073741824" returned: 0 in 0.414s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-0974bafe-94b1-488e-a75a-a6f609caad75-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-0974bafe-94b1-488e-a75a-a6f609caad75-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:42 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7 Sep 09 16:58:42 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-0974bafe-94b1-488e-a75a-a6f609caad75" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-0974bafe-94b1-488e-a75a-a6f609caad75" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b12d71-7956-49d2-a4d7-1b1f83594e2e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:43 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 Sep 09 16:58:43 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:43 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (148e1aa9-4e4f-499d-adb8-9168e7a30919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb3e026-7c88-4179-a57f-2bbabf73dda7', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c62ce2-2aec-438e-b19f-5da24090071d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:43 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Volume volume-edb3e026-7c88-4179-a57f-2bbabf73dda7 (edb3e026-7c88-4179-a57f-2bbabf73dda7): created successfully Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5c62ce2-2aec-438e-b19f-5da24090071d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Flow 'volume_create_manager' (3838b250-b280-46e7-a673-1f00440ab17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3cad563a-5752-4e5e-88f4-85f699fe8726 tempest-ProjectReaderTests-1914591138 None] Created volume successfully. Sep 09 16:58:43 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:43 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75 Sep 09 16:58:43 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:43 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0974bafe-94b1-488e-a75a-a6f609caad75" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-0974bafe-94b1-488e-a75a-a6f609caad75" released by "delete_volume" :: held 0.693s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Created reservations ['bf7a21b0-948e-48fd-9c20-52833a8ecadb', '189314f8-0d3e-4512-bd85-dcfe3260ea73', 'bde92afc-4c0c-483d-9f58-ec56955b473f', 'c7d4ca73-e1fc-4e45-85ae-f6f14fdbb3c8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:43 devstack sudo[103338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:43 devstack sudo[103338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:44 devstack sudo[103338]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.267s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Deleted volume successfully. Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3da8562c-290e-46e5-ab73-614021fdb8a3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-0974bafe-94b1-488e-a75a-a6f609caad75-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-98d5966d-1fa8-4749-9662-7d13540bbfae req-6e31df0a-dff2-4e91-96f2-1006e4794203 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-98d5966d-1fa8-4749-9662-7d13540bbfae req-6e31df0a-dff2-4e91-96f2-1006e4794203 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-98d5966d-1fa8-4749-9662-7d13540bbfae req-6e31df0a-dff2-4e91-96f2-1006e4794203 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-98d5966d-1fa8-4749-9662-7d13540bbfae req-6e31df0a-dff2-4e91-96f2-1006e4794203 tempest-TestInstancesWithCinderVolumes-24597606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '82b0fee4-fd6e-4acd-8808-0ab71d960c6e', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:58:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-98d5966d-1fa8-4749-9662-7d13540bbfae req-6e31df0a-dff2-4e91-96f2-1006e4794203 tempest-TestInstancesWithCinderVolumes-24597606 None] attachment_update completed successfully. Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "cinder-edb3e026-7c88-4179-a57f-2bbabf73dda7-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-edb3e026-7c88-4179-a57f-2bbabf73dda7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Flow 'volume_create_manager' (380c5d25-aad1-49b8-883e-b840f64703c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d4aa5d-e8d4-44d5-bb83-a99493b49fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09d4aa5d-e8d4-44d5-bb83-a99493b49fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-906255480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee5c092-fdb1-4550-8d42-e2a4015c6d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e59bef83db4dc8b326114e3ed0c2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:45Z,use_quota=True,user_id='daf4137791954427a75e3bbf63f70601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a84c29-687e-4153-a5be-afad2ba2f906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66a84c29-687e-4153-a5be-afad2ba2f906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563b7a2a-f79e-45fe-910a-6662270f5efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (563b7a2a-f79e-45fe-910a-6662270f5efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bee5c092-fdb1-4550-8d42-e2a4015c6d09', 'volume_name': 'volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46647351-f444-44b1-b738-5656679274a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46647351-f444-44b1-b738-5656679274a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff933393-d5ed-45a3-a495-b1d505663159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Volume bee5c092-fdb1-4550-8d42-e2a4015c6d09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09', 'volume_size': 1} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-906255480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bee5c092-fdb1-4550-8d42-e2a4015c6d09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e59bef83db4dc8b326114e3ed0c2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:45Z,use_quota=True,user_id='daf4137791954427a75e3bbf63f70601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Creating volume bee5c092-fdb1-4550-8d42-e2a4015c6d09 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:44 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "cinder-quobyte-edb3e026-7c88-4179-a57f-2bbabf73dda7" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:44 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 1073741824 Sep 09 16:58:44 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-quobyte-edb3e026-7c88-4179-a57f-2bbabf73dda7" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0019542-29d8-42ff-acc8-e5af1ea701a4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:45 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7 Sep 09 16:58:45 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:45 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:45 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:45 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7" returned: 0 in 0.441s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:45 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 1073741824" returned: 0 in 0.525s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:45 devstack sudo[103368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7 Sep 09 16:58:45 devstack sudo[103368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:45 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:58:45 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 Sep 09 16:58:45 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:45 devstack sudo[103368]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-edb3e026-7c88-4179-a57f-2bbabf73dda7" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-quobyte-edb3e026-7c88-4179-a57f-2bbabf73dda7" released by "delete_volume" :: held 0.804s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:45 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff933393-d5ed-45a3-a495-b1d505663159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be93e895-d3d7-4f0e-88ec-98077f4b5931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Volume volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 (bee5c092-fdb1-4550-8d42-e2a4015c6d09): created successfully Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be93e895-d3d7-4f0e-88ec-98077f4b5931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Flow 'volume_create_manager' (380c5d25-aad1-49b8-883e-b840f64703c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bc4e9007-5f77-4d06-b428-33fdee03de82 tempest-VolumesSnapshotTestJSON-77225072 None] Created volume successfully. Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Created reservations ['38c492f5-012d-4156-9771-0b739256e4a9', '789e0ee8-a050-4f85-885b-659182b051ef', '817b9197-eb7d-4c67-a1f5-0cffed5ab333', '2fa8572a-1c93-4300-907a-6fe2dc5fd1da'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:45 devstack sudo[103381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:45 devstack sudo[103381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:46 devstack sudo[103381]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:46 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Deleted volume successfully. Sep 09 16:58:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4c6ad070-01b9-467c-80db-87daf33db023 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-edb3e026-7c88-4179-a57f-2bbabf73dda7-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-b3727d2f-2865-4b56-84e4-3c01d12a197f req-c75d0eaf-da5b-45fe-93a8-3cf9cae15cc9 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-b3727d2f-2865-4b56-84e4-3c01d12a197f req-c75d0eaf-da5b-45fe-93a8-3cf9cae15cc9 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-b3727d2f-2865-4b56-84e4-3c01d12a197f req-c75d0eaf-da5b-45fe-93a8-3cf9cae15cc9 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-b3727d2f-2865-4b56-84e4-3c01d12a197f req-c75d0eaf-da5b-45fe-93a8-3cf9cae15cc9 tempest-TestInstancesWithCinderVolumes-24597606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ddc4d89a-3655-488c-baae-baae53b017f5', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 16:58:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-b3727d2f-2865-4b56-84e4-3c01d12a197f req-c75d0eaf-da5b-45fe-93a8-3cf9cae15cc9 tempest-TestInstancesWithCinderVolumes-24597606 None] attachment_update completed successfully. Sep 09 16:58:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Creating offline snapshot fe33f4dc-e701-43df-8579-c46257c92770 of volume bee5c092-fdb1-4550-8d42-e2a4015c6d09 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[356eec49-0af3-4f27-9556-2d7bd99406a2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:47 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 Sep 09 16:58:47 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:47 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09" returned: 0 in 0.487s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:47 devstack sudo[103401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 1G Sep 09 16:58:47 devstack sudo[103401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Flow 'volume_create_manager' (2e7ee609-0217-4638-9811-b367c8da1248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e04c9a7-3e49-40c2-a095-a74c9e6cc637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e04c9a7-3e49-40c2-a095-a74c9e6cc637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778805413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6b533c8246414a86bb61d383a02f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:48Z,use_quota=True,user_id='f507ba118ac944adb7311082eb8ce42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9668d723-821a-4fb7-9500-7b5af36ff4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9668d723-821a-4fb7-9500-7b5af36ff4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e38f78-198c-4e76-ae85-ef39dcb9127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e38f78-198c-4e76-ae85-ef39dcb9127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285', 'volume_name': 'volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1bc505-8c82-421b-9e90-8549f72d723c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1bc505-8c82-421b-9e90-8549f72d723c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1815215e-f8d3-4ff6-851b-68cd111aeb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Volume 5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285', 'volume_size': 1} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:47 devstack sudo[103401]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 1G" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:47 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 Sep 09 16:58:47 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:48 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:48 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 is being set with open permissions: ugo+rw Sep 09 16:58:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:48 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 Sep 09 16:58:48 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:48 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:48 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.info Sep 09 16:58:48 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:48 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.info" returned: 0 in 0.255s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:48 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.info is being set with open permissions: ugo+rw Sep 09 16:58:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:48 devstack sudo[103423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.info Sep 09 16:58:48 devstack sudo[103423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:49 devstack sudo[103423]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.info" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.338s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778805413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a6b533c8246414a86bb61d383a02f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:48Z,use_quota=True,user_id='f507ba118ac944adb7311082eb8ce42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Creating volume 5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:49 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:49 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 1073741824 Sep 09 16:58:49 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-65d9b9d6-c113-4919-ae5c-d0c07aad2445 tempest-VolumesSnapshotTestJSON-77225072 None] Create snapshot completed successfully Sep 09 16:58:49 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 1073741824" returned: 0 in 0.447s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:49 devstack sudo[103434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 Sep 09 16:58:49 devstack sudo[103434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:49 devstack sudo[103434]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285" returned: 0 in 0.295s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1815215e-f8d3-4ff6-851b-68cd111aeb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc65c5d8-3348-4f3f-8e8c-4040245dd609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:49 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Volume volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 (5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285): created successfully Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc65c5d8-3348-4f3f-8e8c-4040245dd609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Flow 'volume_create_manager' (2e7ee609-0217-4638-9811-b367c8da1248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6aeda926-099e-4da0-82ee-7c88954eb4c9 tempest-ProjectReaderTests-1914591138 None] Created volume successfully. Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "cinder-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Flow 'volume_create_manager' (713a3341-af99-457b-8140-bb2f8b32b1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7855b8e8-677c-4f39-97cb-d60f34269032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7855b8e8-677c-4f39-97cb-d60f34269032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-970891119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d54b1354-ce60-4bac-86fc-08f2be208ce8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12e59bef83db4dc8b326114e3ed0c2f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fe33f4dc-e701-43df-8579-c46257c92770,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:58:51Z,use_quota=True,user_id='daf4137791954427a75e3bbf63f70601',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09ee1d7-088d-4ba6-9ac9-778991978a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09ee1d7-088d-4ba6-9ac9-778991978a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d552c932-8073-4c61-b401-7f9b30de26fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d552c932-8073-4c61-b401-7f9b30de26fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd54b1354-ce60-4bac-86fc-08f2be208ce8', 'volume_name': 'volume-d54b1354-ce60-4bac-86fc-08f2be208ce8', 'volume_size': 1, 'snapshot_id': 'fe33f4dc-e701-43df-8579-c46257c92770'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1474ac78-7acc-4568-902a-a3d41bf776c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1474ac78-7acc-4568-902a-a3d41bf776c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f105ba0-116f-4e04-b8ff-978047e68b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Volume d54b1354-ce60-4bac-86fc-08f2be208ce8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d54b1354-ce60-4bac-86fc-08f2be208ce8', 'volume_size': 1, 'snapshot_id': 'fe33f4dc-e701-43df-8579-c46257c92770'} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-fe33f4dc-e701-43df-8579-c46257c92770-d54b1354-ce60-4bac-86fc-08f2be208ce8" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-fe33f4dc-e701-43df-8579-c46257c92770-d54b1354-ce60-4bac-86fc-08f2be208ce8" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Creating volume d54b1354-ce60-4bac-86fc-08f2be208ce8 from snapshot fe33f4dc-e701-43df-8579-c46257c92770 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-d54b1354-ce60-4bac-86fc-08f2be208ce8" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "cinder-quobyte-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-d54b1354-ce60-4bac-86fc-08f2be208ce8" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] snapshot: fe33f4dc-e701-43df-8579-c46257c92770, volume: d54b1354-ce60-4bac-86fc-08f2be208ce8, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-quobyte-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e8ab56-22bb-48f8-b794-f33f22770ffb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e87b88-d34c-4de9-bceb-7e25619f1b1d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:51 devstack sudo[103457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 Sep 09 16:58:51 devstack sudo[103457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:51 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 Sep 09 16:58:51 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:51 devstack sudo[103457]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:51 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:51 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285 Sep 09 16:58:51 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770" returned: 0 in 0.412s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7404bf16-0604-4cfe-a7c9-851edc749974]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-381e5e6c-68c6-48cb-8f09-6e93b64ae149 req-e6a58825-9779-40f4-93dd-564e19d8441b tempest-TestInstancesWithCinderVolumes-24597606 None] Terminate volume connection completed successfully. Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-381e5e6c-68c6-48cb-8f09-6e93b64ae149 req-e6a58825-9779-40f4-93dd-564e19d8441b tempest-TestInstancesWithCinderVolumes-24597606 None] Deleting attachment 82b0fee4-fd6e-4acd-8808-0ab71d960c6e. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:58:51 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 Sep 09 16:58:51 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:51 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-quobyte-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285" released by "delete_volume" :: held 0.793s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Created reservations ['6f5418f2-e241-49ac-9349-4613d738e4c9', 'f6b9fb8b-83c4-456f-b787-c1aed5dc70c7', 'ed7167d8-fa7f-46b5-acf5-af90788028c4', 'b8187ded-29a2-472b-ba7c-945dc2fcf4b5'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:51 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:51 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:51 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 16:58:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:51 devstack sudo[103479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 Sep 09 16:58:51 devstack sudo[103479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:52 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:52 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Deleted volume successfully. Sep 09 16:58:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1a65cb6-f49b-4259-a3ed-f2306f146958 tempest-ProjectReaderTests-1914591138 None] Lock "cinder-5cd49ce1-e0d1-49a7-ba6d-18ad1bedf285-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "cinder-4adcfded-d088-4ee8-bd66-c1c3f403e2c3-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-4adcfded-d088-4ee8-bd66-c1c3f403e2c3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "cinder-quobyte-4adcfded-d088-4ee8-bd66-c1c3f403e2c3" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-quobyte-4adcfded-d088-4ee8-bd66-c1c3f403e2c3" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[add75c61-2d19-4d2e-9ec5-b4f1e6e369e9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:52 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3 Sep 09 16:58:52 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:53 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3" returned: 0 in 0.783s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:53 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3 Sep 09 16:58:53 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:53 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4adcfded-d088-4ee8-bd66-c1c3f403e2c3" returned: 0 in 0.761s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-quobyte-4adcfded-d088-4ee8-bd66-c1c3f403e2c3" released by "delete_volume" :: held 1.621s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:53 devstack cinder-volume[87498]: WARNING cinder.quota [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898269737-66215617 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898269737-66215617, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:58:53 devstack cinder-volume[87498]: WARNING cinder.quota [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898269737-66215617 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1898269737-66215617, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:58:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Created reservations ['2ff05569-ae58-45ef-8263-d86bb375ab8b', '07bb1144-eb47-4acc-888f-f58fa2cc9bff', 'b16d4117-17a3-487c-8e15-3353fc036723', 'aa67537d-19b0-4b81-b413-155d5262a599'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:54 devstack sudo[103504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:54 devstack sudo[103504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:54 devstack sudo[103504]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.407s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:54 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:58:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Deleted volume successfully. Sep 09 16:58:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2b08ef7b-c905-4522-ac2d-86f8dd7500b0 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-4adcfded-d088-4ee8-bd66-c1c3f403e2c3-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:57 devstack sudo[103479]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8" returned: 0 in 5.852s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:57 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:58:57 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Converted 1024.00 MB image at 174.91 MB/s Sep 09 16:58:57 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 is being set with open permissions: ugo+rw Sep 09 16:58:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:57 devstack sudo[103533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 Sep 09 16:58:57 devstack sudo[103533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:57 devstack sudo[103533]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-d54b1354-ce60-4bac-86fc-08f2be208ce8" released by "_copy_volume_from_snapshot" :: held 7.105s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-5b74f67d-8b3f-4130-a255-afca74944bc1 req-1e603b0d-0a38-4b39-b6b6-52fd2292e277 tempest-TestInstancesWithCinderVolumes-24597606 None] Terminate volume connection completed successfully. Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-5b74f67d-8b3f-4130-a255-afca74944bc1 req-1e603b0d-0a38-4b39-b6b6-52fd2292e277 tempest-TestInstancesWithCinderVolumes-24597606 None] Deleting attachment ddc4d89a-3655-488c-baae-baae53b017f5. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-fe33f4dc-e701-43df-8579-c46257c92770-d54b1354-ce60-4bac-86fc-08f2be208ce8" released by "_create_volume_from_snapshot" :: held 7.189s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.218s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f105ba0-116f-4e04-b8ff-978047e68b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d54b1354-ce60-4bac-86fc-08f2be208ce8', 'volume_size': 1, 'snapshot_id': 'fe33f4dc-e701-43df-8579-c46257c92770'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb45eb2-988e-4c2f-a76e-eb04c39ebc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:58:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Volume volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 (d54b1354-ce60-4bac-86fc-08f2be208ce8): created successfully Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acb45eb2-988e-4c2f-a76e-eb04c39ebc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Flow 'volume_create_manager' (713a3341-af99-457b-8140-bb2f8b32b1c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:58:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-35ceb708-4f47-4910-b92b-91f72e5cfcd3 tempest-VolumesSnapshotTestJSON-77225072 None] Created volume successfully. Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-d54b1354-ce60-4bac-86fc-08f2be208ce8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "cinder-f9e0982c-38f5-4684-bf05-de55adc6bd9d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-d54b1354-ce60-4bac-86fc-08f2be208ce8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-f9e0982c-38f5-4684-bf05-de55adc6bd9d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-d54b1354-ce60-4bac-86fc-08f2be208ce8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "cinder-quobyte-f9e0982c-38f5-4684-bf05-de55adc6bd9d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-d54b1354-ce60-4bac-86fc-08f2be208ce8" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d89aa6-039b-4408-930f-5f7e0fbb7b0a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-quobyte-f9e0982c-38f5-4684-bf05-de55adc6bd9d" acquired by "delete_volume" :: waited 0.047s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae79a86a-dabf-4d3f-9f5c-c3d1494bfc8f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:58:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:58 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d Sep 09 16:58:58 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:58 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 Sep 09 16:58:58 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:59 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:59 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:59 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8 Sep 09 16:58:59 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:59 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d Sep 09 16:58:59 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:59 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d54b1354-ce60-4bac-86fc-08f2be208ce8" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-d54b1354-ce60-4bac-86fc-08f2be208ce8" released by "delete_volume" :: held 0.809s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:59 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f9e0982c-38f5-4684-bf05-de55adc6bd9d" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-quobyte-f9e0982c-38f5-4684-bf05-de55adc6bd9d" released by "delete_volume" :: held 0.811s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:58:59 devstack cinder-volume[87498]: WARNING cinder.quota [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-902455350-536478463 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-902455350-536478463, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:58:59 devstack cinder-volume[87498]: WARNING cinder.quota [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-902455350-536478463 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-902455350-536478463, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Created reservations ['b17f9a8d-6e6e-41fd-88b8-0d36b5a0c354', 'de2cf2ce-8a0f-4f18-b8e4-3c58758a2e2a', 'ca4168d1-90a6-4bd8-af21-48917410d742', '97d8dda5-09fa-479c-83aa-f3aacc4fc987'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Created reservations ['ee65a2c3-3921-4885-ae09-df7a384a928c', '867f77a9-76e3-4fe2-a3b4-59cb022b7e7a', 'b551655c-8067-42ac-8ea2-dfeaaa55d4f9', 'dcbb580d-baa8-4d3e-a9e9-d629fc75364a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:58:59 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:58:59 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:58:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-fe33f4dc-e701-43df-8579-c46257c92770-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:58:59 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:58:59 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-fe33f4dc-e701-43df-8579-c46257c92770-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-bee5c092-fdb1-4550-8d42-e2a4015c6d09" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-bee5c092-fdb1-4550-8d42-e2a4015c6d09" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-fe33f4dc-e701-43df-8579-c46257c92770" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-fe33f4dc-e701-43df-8579-c46257c92770" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Deleting offline snapshot fe33f4dc-e701-43df-8579-c46257c92770 of volume bee5c092-fdb1-4550-8d42-e2a4015c6d09 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] snapshot_file for this snap is: volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4367cde-20bc-4e35-bcbc-fd00d898e344]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:00 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:59:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Deleted volume successfully. Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4d6c6800-d54c-4649-adcd-544723532e9e tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-d54b1354-ce60-4bac-86fc-08f2be208ce8-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:00 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 Sep 09 16:59:00 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:00 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.444s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:59:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Deleted volume successfully. Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ab92484-97a7-49a0-98ba-1c0999528928 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-f9e0982c-38f5-4684-bf05-de55adc6bd9d-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:00 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770" returned: 0 in 0.552s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9ca212-f5c8-4324-91e4-d8d5bef660d9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:00 devstack sudo[103569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 Sep 09 16:59:00 devstack sudo[103569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:01 devstack sudo[103569]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09" returned: 0 in 0.563s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:01 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 Sep 09 16:59:01 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:01 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770" returned: 0 in 0.470s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:01 devstack sudo[103582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770 Sep 09 16:59:01 devstack sudo[103582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:02 devstack sudo[103582]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09.fe33f4dc-e701-43df-8579-c46257c92770" returned: 0 in 0.299s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-fe33f4dc-e701-43df-8579-c46257c92770" released by "_delete_snapshot" :: held 2.108s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-bee5c092-fdb1-4550-8d42-e2a4015c6d09" released by "delete_snapshot" :: held 2.150s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Created reservations ['c0e1f012-7b4a-4912-bb7b-7ebada980227', 'e91da031-1f9d-4966-8ac4-558ffb4138cf', 'ec40f4cc-ab78-4c61-9fb0-c72a61948057', 'eb7f94ec-63dc-4ae5-9e43-ade6866044fc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:59:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Delete snapshot completed successfully. Sep 09 16:59:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e4e7747f-9521-4cfe-a271-7b1aa1f4a2ae tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-fe33f4dc-e701-43df-8579-c46257c92770-delete_snapshot" released by "delete_snapshot" :: held 2.476s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-bee5c092-fdb1-4550-8d42-e2a4015c6d09-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-bee5c092-fdb1-4550-8d42-e2a4015c6d09-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-bee5c092-fdb1-4550-8d42-e2a4015c6d09" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-bee5c092-fdb1-4550-8d42-e2a4015c6d09" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7734ba8b-2fe2-4cfa-9a1c-d42a68e53d47]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:03 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 Sep 09 16:59:03 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-3a6b2150-2c30-46ab-b4b4-1493020e07a3 req-720ddd4a-64c2-469b-bb08-db6e1e6f240e tempest-TestInstancesWithCinderVolumes-24597606 None] Terminate volume connection completed successfully. Sep 09 16:59:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-3a6b2150-2c30-46ab-b4b4-1493020e07a3 req-720ddd4a-64c2-469b-bb08-db6e1e6f240e tempest-TestInstancesWithCinderVolumes-24597606 None] Deleting attachment b13a202f-bef6-4082-b31d-e45251c589c4. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 16:59:04 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09" returned: 0 in 0.597s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:04 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09 Sep 09 16:59:04 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:04 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-bee5c092-fdb1-4550-8d42-e2a4015c6d09" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-bee5c092-fdb1-4550-8d42-e2a4015c6d09" released by "delete_volume" :: held 1.123s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Created reservations ['a1a14654-4214-4456-ab54-c0e54c38bc8c', 'b2c3e858-fb38-4a7f-aee5-ac508857eb3e', 'c25a2cb6-7965-48ff-9bd6-615f6171b4e0', '367b5b7e-f6a9-4d9f-b382-923ed85c0cbd'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:04 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:59:04 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:05 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:59:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Deleted volume successfully. Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-82a83fb7-1cae-4e5a-8d49-5babd629e4e6 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-bee5c092-fdb1-4550-8d42-e2a4015c6d09-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "cinder-2e03f8ec-9078-4f90-8fe7-91f300e711cf-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-2e03f8ec-9078-4f90-8fe7-91f300e711cf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "cinder-quobyte-2e03f8ec-9078-4f90-8fe7-91f300e711cf" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-quobyte-2e03f8ec-9078-4f90-8fe7-91f300e711cf" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bcb8c6-24d8-477d-91e9-3488a7e8d117]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:05 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf Sep 09 16:59:05 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:05 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf" returned: 0 in 0.420s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:05 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf Sep 09 16:59:05 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-320468a0-04c0-4cb8-aa9b-0ff2158282d5-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-320468a0-04c0-4cb8-aa9b-0ff2158282d5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "cinder-quobyte-320468a0-04c0-4cb8-aa9b-0ff2158282d5" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-320468a0-04c0-4cb8-aa9b-0ff2158282d5" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbd194c-173c-45d7-a21b-0560fad89074]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:05 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2e03f8ec-9078-4f90-8fe7-91f300e711cf" returned: 0 in 0.308s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-quobyte-2e03f8ec-9078-4f90-8fe7-91f300e711cf" released by "delete_volume" :: held 0.778s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:05 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 Sep 09 16:59:05 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:05 devstack cinder-volume[87498]: WARNING cinder.quota [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1520929759-864216377 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1520929759-864216377, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:59:05 devstack cinder-volume[87498]: WARNING cinder.quota [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1520929759-864216377 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1520929759-864216377, it is now deprecated. Please use the default quota class for default quota. Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Created reservations ['1b580f2e-d119-4bd6-838c-037cdf40922c', 'da73014b-8afc-4ff6-871c-98b191b08231', 'd5d7a7f2-5d9d-402b-9666-ab1ee3fc4c3d', '61aebc97-a2d8-440b-85eb-0e58cb11eedc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:06 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:59:06 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:06 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:06 devstack sudo[103635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5 Sep 09 16:59:06 devstack sudo[103635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:06 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:59:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Deleted volume successfully. Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-08a23d36-ff82-4067-8a1a-16529630ffd9 tempest-TestInstancesWithCinderVolumes-24597606 None] Lock "cinder-2e03f8ec-9078-4f90-8fe7-91f300e711cf-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:06 devstack sudo[103635]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-320468a0-04c0-4cb8-aa9b-0ff2158282d5" returned: 0 in 0.336s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-quobyte-320468a0-04c0-4cb8-aa9b-0ff2158282d5" released by "delete_volume" :: held 0.841s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Created reservations ['09dbf4b6-a71f-46dd-b2f9-b66276e34daf', '4f47ae5c-ab5e-4e59-8acf-1318251ae922', 'f9d95576-3570-406c-b3c6-8311ea49a41e', 'd3530646-9e93-4bbe-b877-1447a5362465'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:06 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:59:06 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:07 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:07 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:59:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Deleted volume successfully. Sep 09 16:59:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ae13d-dad5-4798-a2db-75e2280a2558 tempest-VolumesSnapshotTestJSON-77225072 None] Lock "cinder-320468a0-04c0-4cb8-aa9b-0ff2158282d5-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:16 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=143,cinder:SELECT=101,cinder:INSERT=30,cinder:DELETE=11 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:59:17 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=111,cinder:UPDATE=121,cinder:DELETE=9,cinder:INSERT=34 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Flow 'volume_create_manager' (6bd6fcb9-1a58-427a-8437-7a7db8eec644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9539f4-1ff4-4043-8178-53da3ed86daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b9539f4-1ff4-4043-8178-53da3ed86daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1819957219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a256989-2ca2-47c3-bcaa-e70aa4a17711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57b0f15f728465d86e11423319ba49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:59:23Z,use_quota=True,user_id='e41f1e17eff84f71a28e570117a36785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee05c18-2a7e-464a-aab4-82a076c5d48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee05c18-2a7e-464a-aab4-82a076c5d48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d93e627-5b45-4204-8e15-a24831d77de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d93e627-5b45-4204-8e15-a24831d77de3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a256989-2ca2-47c3-bcaa-e70aa4a17711', 'volume_name': 'volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8326d956-f696-496b-900f-0ddae41c3ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8326d956-f696-496b-900f-0ddae41c3ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3acd96-5f27-4005-9536-b791a94865ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Volume 8a256989-2ca2-47c3-bcaa-e70aa4a17711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711', 'volume_size': 1} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1819957219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a256989-2ca2-47c3-bcaa-e70aa4a17711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57b0f15f728465d86e11423319ba49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:59:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:59:23Z,use_quota=True,user_id='e41f1e17eff84f71a28e570117a36785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Creating volume 8a256989-2ca2-47c3-bcaa-e70aa4a17711 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:59:22 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:59:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:22 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 1073741824 Sep 09 16:59:22 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:23 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 1073741824" returned: 0 in 0.525s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:23 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 Sep 09 16:59:23 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:23 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711" returned: 0 in 0.353s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:59:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3acd96-5f27-4005-9536-b791a94865ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb5c0ab-4d3b-4e77-9a70-ad05cc5e9621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Volume volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 (8a256989-2ca2-47c3-bcaa-e70aa4a17711): created successfully Sep 09 16:59:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fb5c0ab-4d3b-4e77-9a70-ad05cc5e9621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Flow 'volume_create_manager' (6bd6fcb9-1a58-427a-8437-7a7db8eec644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:59:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cb5aa7c5-fd06-43e6-b4a6-fa757f98b640 tempest-SnapshotDependencyTests-766451805 None] Created volume successfully. Sep 09 16:59:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Creating offline snapshot 37a2912f-7fe4-4891-9d4f-80825288bc75 of volume 8a256989-2ca2-47c3-bcaa-e70aa4a17711 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 16:59:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1837eb1e-fe52-403f-81f6-429ba0b140a8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:25 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 Sep 09 16:59:25 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:25 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711" returned: 0 in 0.461s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:25 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 1G Sep 09 16:59:25 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:26 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 1G" returned: 0 in 0.504s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:26 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 Sep 09 16:59:26 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:26 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:26 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 is being set with open permissions: ugo+rw Sep 09 16:59:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:26 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 Sep 09 16:59:26 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:26 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75" returned: 0 in 0.285s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:26 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.info Sep 09 16:59:26 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:27 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.info" returned: 0 in 0.481s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:27 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.info is being set with open permissions: ugo+rw Sep 09 16:59:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:27 devstack sudo[103719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.info Sep 09 16:59:27 devstack sudo[103719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:27 devstack sudo[103719]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.info" returned: 0 in 0.409s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.603s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8e1ec580-1ead-42e6-a960-3b821cd8a20a tempest-SnapshotDependencyTests-766451805 None] Create snapshot completed successfully Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Flow 'volume_create_manager' (3fac3b6a-8f3d-40b9-b835-5e302a2d156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa81e74-470d-4307-8347-f11f5aa4562f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa81e74-470d-4307-8347-f11f5aa4562f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03eba437-ceff-469c-88ea-c3dbd5e795fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c57b0f15f728465d86e11423319ba49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=37a2912f-7fe4-4891-9d4f-80825288bc75,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:59:29Z,use_quota=True,user_id='e41f1e17eff84f71a28e570117a36785',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef737fd4-2212-4711-9b52-82843ccb0050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef737fd4-2212-4711-9b52-82843ccb0050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6740fa-82f8-4af4-a623-c640911fc7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6740fa-82f8-4af4-a623-c640911fc7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '03eba437-ceff-469c-88ea-c3dbd5e795fe', 'volume_name': 'volume-03eba437-ceff-469c-88ea-c3dbd5e795fe', 'volume_size': 1, 'snapshot_id': '37a2912f-7fe4-4891-9d4f-80825288bc75'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbd913e-f2f1-4fb0-a456-a77f24578560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dbd913e-f2f1-4fb0-a456-a77f24578560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c242a0-75e8-423e-a1c6-ba3fb15d8898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Volume 03eba437-ceff-469c-88ea-c3dbd5e795fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-03eba437-ceff-469c-88ea-c3dbd5e795fe', 'volume_size': 1, 'snapshot_id': '37a2912f-7fe4-4891-9d4f-80825288bc75'} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "cinder-quobyte-37a2912f-7fe4-4891-9d4f-80825288bc75-03eba437-ceff-469c-88ea-c3dbd5e795fe" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-37a2912f-7fe4-4891-9d4f-80825288bc75-03eba437-ceff-469c-88ea-c3dbd5e795fe" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Creating volume 03eba437-ceff-469c-88ea-c3dbd5e795fe from snapshot 37a2912f-7fe4-4891-9d4f-80825288bc75 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "cinder-quobyte-03eba437-ceff-469c-88ea-c3dbd5e795fe" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-03eba437-ceff-469c-88ea-c3dbd5e795fe" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] snapshot: 37a2912f-7fe4-4891-9d4f-80825288bc75, volume: 03eba437-ceff-469c-88ea-c3dbd5e795fe, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f0e4fe-bb44-4ead-baaa-39f2866020b7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:29 devstack sudo[103724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 Sep 09 16:59:29 devstack sudo[103724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:29 devstack sudo[103724]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75" returned: 0 in 0.465s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bf3761-7c5e-40b4-956f-12372fc787f0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:29 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 Sep 09 16:59:29 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:30 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711" returned: 0 in 0.440s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 16:59:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 16:59:30 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 16:59:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:30 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe Sep 09 16:59:30 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:35 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe" returned: 0 in 5.451s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:35 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 16:59:35 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Converted 1024.00 MB image at 187.79 MB/s Sep 09 16:59:35 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe is being set with open permissions: ugo+rw Sep 09 16:59:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:35 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe Sep 09 16:59:35 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:35 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-03eba437-ceff-469c-88ea-c3dbd5e795fe" released by "_copy_volume_from_snapshot" :: held 6.740s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-37a2912f-7fe4-4891-9d4f-80825288bc75-03eba437-ceff-469c-88ea-c3dbd5e795fe" released by "_create_volume_from_snapshot" :: held 6.830s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.849s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38c242a0-75e8-423e-a1c6-ba3fb15d8898) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03eba437-ceff-469c-88ea-c3dbd5e795fe', 'volume_size': 1, 'snapshot_id': '37a2912f-7fe4-4891-9d4f-80825288bc75'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c4a83e-32f8-440b-aef9-09eac63568a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Volume volume-03eba437-ceff-469c-88ea-c3dbd5e795fe (03eba437-ceff-469c-88ea-c3dbd5e795fe): created successfully Sep 09 16:59:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2c4a83e-32f8-440b-aef9-09eac63568a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Flow 'volume_create_manager' (3fac3b6a-8f3d-40b9-b835-5e302a2d156c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:59:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8b0f60a9-7ed6-4006-a84b-f4692fe5e0c8 tempest-SnapshotDependencyTests-766451805 None] Created volume successfully. Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "cinder-37a2912f-7fe4-4891-9d4f-80825288bc75-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-37a2912f-7fe4-4891-9d4f-80825288bc75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "cinder-quobyte-8a256989-2ca2-47c3-bcaa-e70aa4a17711" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-8a256989-2ca2-47c3-bcaa-e70aa4a17711" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "cinder-quobyte-37a2912f-7fe4-4891-9d4f-80825288bc75" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-37a2912f-7fe4-4891-9d4f-80825288bc75" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Deleting offline snapshot 37a2912f-7fe4-4891-9d4f-80825288bc75 of volume 8a256989-2ca2-47c3-bcaa-e70aa4a17711 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] snapshot_file for this snap is: volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3304100-59ac-4b56-9740-092443e0b2f8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:37 devstack sudo[103752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 Sep 09 16:59:37 devstack sudo[103752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:37 devstack sudo[103752]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75" returned: 0 in 0.428s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b24d4b-7355-4af9-aad6-ae32a122d597]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:37 devstack sudo[103757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 Sep 09 16:59:37 devstack sudo[103757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:38 devstack sudo[103757]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711" returned: 0 in 0.626s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:38 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 Sep 09 16:59:38 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:38 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75" returned: 0 in 0.518s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:38 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75 Sep 09 16:59:38 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:39 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711.37a2912f-7fe4-4891-9d4f-80825288bc75" returned: 0 in 0.383s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-37a2912f-7fe4-4891-9d4f-80825288bc75" released by "_delete_snapshot" :: held 2.107s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-8a256989-2ca2-47c3-bcaa-e70aa4a17711" released by "delete_snapshot" :: held 2.141s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:39 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Created reservations ['bdfade1c-0f33-4b52-8edf-5009930b7ff6', '006394ea-2372-4cf3-b9ef-83b7c073cbda', '7c3fd8f4-2c8a-4e16-b919-fe8ab52e903e', '2b99a9ca-f4f7-4322-9802-d86c80ebb5bf'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:59:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Delete snapshot completed successfully. Sep 09 16:59:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0d4df6fd-5fef-40c9-9d14-36f774f11366 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-37a2912f-7fe4-4891-9d4f-80825288bc75-delete_snapshot" released by "delete_snapshot" :: held 2.360s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "cinder-8a256989-2ca2-47c3-bcaa-e70aa4a17711-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-8a256989-2ca2-47c3-bcaa-e70aa4a17711-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "cinder-quobyte-8a256989-2ca2-47c3-bcaa-e70aa4a17711" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-8a256989-2ca2-47c3-bcaa-e70aa4a17711" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a60de6-1038-4978-8c41-2f485d6c2178]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:40 devstack sudo[103771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 Sep 09 16:59:40 devstack sudo[103771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:41 devstack sudo[103771]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711" returned: 0 in 0.417s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:41 devstack sudo[103776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711 Sep 09 16:59:41 devstack sudo[103776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:41 devstack sudo[103776]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8a256989-2ca2-47c3-bcaa-e70aa4a17711" returned: 0 in 0.302s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-8a256989-2ca2-47c3-bcaa-e70aa4a17711" released by "delete_volume" :: held 0.843s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Created reservations ['bf1b9fe9-f707-4a35-8b2f-39421a4c3744', '44ebf019-d4de-4464-89a6-f26ebf12f4d2', 'e4847d05-dd61-4b29-89d4-6682fe073a30', 'd18cc5ca-80c0-4dd5-a0b2-2cebdf154dea'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:41 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:59:41 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "cinder-03eba437-ceff-469c-88ea-c3dbd5e795fe-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-03eba437-ceff-469c-88ea-c3dbd5e795fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "cinder-quobyte-03eba437-ceff-469c-88ea-c3dbd5e795fe" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-03eba437-ceff-469c-88ea-c3dbd5e795fe" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27636e0-eef7-45d8-bdda-80a076854206]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:41 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.376s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:41 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:59:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Deleted volume successfully. Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c01b4826-e446-4190-b0ff-4986dfa8bbde tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-8a256989-2ca2-47c3-bcaa-e70aa4a17711-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:42 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe Sep 09 16:59:42 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:42 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe" returned: 0 in 0.465s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:42 devstack sudo[103793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe Sep 09 16:59:42 devstack sudo[103793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:42 devstack sudo[103793]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-03eba437-ceff-469c-88ea-c3dbd5e795fe" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-quobyte-03eba437-ceff-469c-88ea-c3dbd5e795fe" released by "delete_volume" :: held 0.844s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Created reservations ['7c77e575-6bff-4375-9817-b974a56b3b95', 'b843eac4-6178-472e-b8ff-f32c811c4106', '72f7f5a4-c400-4b6f-a30b-7380ffdee6ce', 'caee1005-9f40-4072-bbba-7cf64655879b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:42 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:59:42 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:43 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.337s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:43 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:59:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Deleted volume successfully. Sep 09 16:59:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afe2af73-5f0d-4a6c-899b-3fb59ad53ca1 tempest-SnapshotDependencyTests-766451805 None] Lock "cinder-03eba437-ceff-469c-88ea-c3dbd5e795fe-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:45 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 16:59:45 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:45 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 16:59:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 16:59:52 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=21,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=28,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Flow 'volume_create_manager' (798005a4-a129-401a-818b-ea4ba2e8ffb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9e32a2-1049-497f-b3c4-a6f5155db88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b9e32a2-1049-497f-b3c4-a6f5155db88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-943037549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b70821-f48d-4c3e-8847-f5ea3ebb7837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd566225a954edc965a55b1fda68e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:59:54Z,use_quota=True,user_id='0480552da35b402897189400d047cfb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4db7254-5371-4609-9758-1dd311dcb395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4db7254-5371-4609-9758-1dd311dcb395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d115542-3518-4e2b-9c77-6e6c4bd8aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d115542-3518-4e2b-9c77-6e6c4bd8aad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74b70821-f48d-4c3e-8847-f5ea3ebb7837', 'volume_name': 'volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d49c5ef-4a0d-48cd-ba3d-4e9f34656dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d49c5ef-4a0d-48cd-ba3d-4e9f34656dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b98d55-4e6a-4693-9d6d-3a4e858ae666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Volume 74b70821-f48d-4c3e-8847-f5ea3ebb7837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837', 'volume_size': 1} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T14:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-943037549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74b70821-f48d-4c3e-8847-f5ea3ebb7837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bdd566225a954edc965a55b1fda68e36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T14:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T14:59:54Z,use_quota=True,user_id='0480552da35b402897189400d047cfb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Creating volume 74b70821-f48d-4c3e-8847-f5ea3ebb7837 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 16:59:53 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 16:59:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:53 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 1073741824 Sep 09 16:59:53 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:54 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 1073741824" returned: 0 in 0.534s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:54 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 Sep 09 16:59:54 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:54 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837" returned: 0 in 0.338s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 16:59:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 16:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b98d55-4e6a-4693-9d6d-3a4e858ae666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1276906-6b84-4595-a3b4-75cbe20f9555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 16:59:54 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Volume volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 (74b70821-f48d-4c3e-8847-f5ea3ebb7837): created successfully Sep 09 16:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1276906-6b84-4595-a3b4-75cbe20f9555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 16:59:54 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Flow 'volume_create_manager' (798005a4-a129-401a-818b-ea4ba2e8ffb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 16:59:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ef8a31ce-ccfa-4433-84b7-0fe13b487333 tempest-TestImageHashVerification-621775193 None] Created volume successfully. Sep 09 16:59:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 16:59:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 16:59:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d216347-4205-4a90-8d4a-ac102813ac8b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:57 devstack sudo[103820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 Sep 09 16:59:57 devstack sudo[103820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:57 devstack sudo[103820]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[98831fb4-fac8-4014-bd33-119a31e58d62]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 16:59:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:57 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 Sep 09 16:59:57 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 16:59:57 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Sep 09 16:59:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 16:59:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 /opt/stack/data/cinder/conversion/74b70821-f48d-4c3e-8847-f5ea3ebb7837.temp_image.34e98fd8-3022-4206-b0f3-1bc333ac02b80cmf_5_h.img {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 16:59:57 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 /opt/stack/data/cinder/conversion/74b70821-f48d-4c3e-8847-f5ea3ebb7837.temp_image.34e98fd8-3022-4206-b0f3-1bc333ac02b80cmf_5_h.img Sep 09 16:59:57 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:03 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 /opt/stack/data/cinder/conversion/74b70821-f48d-4c3e-8847-f5ea3ebb7837.temp_image.34e98fd8-3022-4206-b0f3-1bc333ac02b80cmf_5_h.img" returned: 0 in 5.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8881a396-c313-4761-8375-cee2ff242532]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:00:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:00:03 devstack sudo[103848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 Sep 09 17:00:03 devstack sudo[103848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:03 devstack sudo[103848]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837" returned: 0 in 0.633s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:03 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/conversion/74b70821-f48d-4c3e-8847-f5ea3ebb7837.temp_image.34e98fd8-3022-4206-b0f3-1bc333ac02b80cmf_5_h.img {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:00:03 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Converted 1024.00 MB image at 195.54 MB/s Sep 09 17:00:03 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] 34e98fd8-3022-4206-b0f3-1bc333ac02b8 was raw, no need to convert to raw {{(pid=87498) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 09 17:00:20 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:00:20 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:00:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.091s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:00:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Uploaded volume to glance image-id: 34e98fd8-3022-4206-b0f3-1bc333ac02b8. {{(pid=87498) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 09 17:00:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ed963d9e-250d-4237-8365-3b4daabb13f4 tempest-TestImageHashVerification-621775193 None] Copy volume to image completed successfully. Sep 09 17:00:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Acquiring lock "cinder-74b70821-f48d-4c3e-8847-f5ea3ebb7837-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:00:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Lock "cinder-74b70821-f48d-4c3e-8847-f5ea3ebb7837-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:00:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Acquiring lock "cinder-quobyte-74b70821-f48d-4c3e-8847-f5ea3ebb7837" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:00:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Lock "cinder-quobyte-74b70821-f48d-4c3e-8847-f5ea3ebb7837" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:00:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6f3c0b-2911-47b0-86f1-652eb7555aa0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:00:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:00:26 devstack sudo[103976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 Sep 09 17:00:26 devstack sudo[103976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:26 devstack sudo[103976]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:00:26 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837 Sep 09 17:00:26 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:26 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-74b70821-f48d-4c3e-8847-f5ea3ebb7837" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Lock "cinder-quobyte-74b70821-f48d-4c3e-8847-f5ea3ebb7837" released by "delete_volume" :: held 0.635s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Created reservations ['2a43cb6f-3a36-4fe5-9326-6cc6635b1cc9', '7a8025f0-15e6-4123-a2e8-ab0bb6a7aaff', 'ddd7e107-f6de-4860-9067-a7cca942bebf', '3bc03cf7-c4ea-4502-b31f-7140c958dc18'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:00:26 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:00:26 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:26 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:00:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Deleted volume successfully. Sep 09 17:00:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2381d318-f63b-4fb4-a1c2-a31e7f2b52e3 tempest-TestImageHashVerification-621775193 None] Lock "cinder-74b70821-f48d-4c3e-8847-f5ea3ebb7837-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Flow 'volume_create_manager' (ed5582a0-b9d9-4539-a4a3-05b3dfba237a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33f45a6-4695-4f6c-875a-9a9a8670d71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33f45a6-4695-4f6c-875a-9a9a8670d71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-538021965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149e8cc7-6ec9-4574-ba27-b3ecb40b93ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdb3857fea64fc6b1c2108281a854fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:00:33Z,use_quota=True,user_id='4a27715f968644e2a87e9fc2ac1c19f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a70ff9-80f3-4838-bfdb-0cac4c6ddb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4a70ff9-80f3-4838-bfdb-0cac4c6ddb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84d5d9c-403d-4f37-86d8-250755395a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84d5d9c-403d-4f37-86d8-250755395a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149e8cc7-6ec9-4574-ba27-b3ecb40b93ca', 'volume_name': 'volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c8afeb-e276-4c95-a5c0-c2d38882823e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77c8afeb-e276-4c95-a5c0-c2d38882823e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936c1ed5-131b-4c6f-aa40-16418178a704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:00:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Volume 149e8cc7-6ec9-4574-ba27-b3ecb40b93ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca', 'volume_size': 1} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:00:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-538021965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149e8cc7-6ec9-4574-ba27-b3ecb40b93ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfdb3857fea64fc6b1c2108281a854fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:00:33Z,use_quota=True,user_id='4a27715f968644e2a87e9fc2ac1c19f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Creating volume 149e8cc7-6ec9-4574-ba27-b3ecb40b93ca {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:00:33 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:00:33 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca 1073741824 Sep 09 17:00:33 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:33 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca 1073741824" returned: 0 in 0.407s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:00:33 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca Sep 09 17:00:33 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:33 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (936c1ed5-131b-4c6f-aa40-16418178a704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c19bcef-86d4-4c64-89e0-a4fe9e82cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:00:33 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Volume volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca (149e8cc7-6ec9-4574-ba27-b3ecb40b93ca): created successfully Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c19bcef-86d4-4c64-89e0-a4fe9e82cb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:00:33 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Flow 'volume_create_manager' (ed5582a0-b9d9-4539-a4a3-05b3dfba237a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:00:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0015b8a9-4c4d-4ea9-9de7-07826f649ec1 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Created volume successfully. Sep 09 17:00:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-85452151-ea08-4b9f-858a-3ff3e5779282 req-e26a77c5-22ca-4b64-a908-8e95f5264471 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:00:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-85452151-ea08-4b9f-858a-3ff3e5779282 req-e26a77c5-22ca-4b64-a908-8e95f5264471 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:00:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-85452151-ea08-4b9f-858a-3ff3e5779282 req-e26a77c5-22ca-4b64-a908-8e95f5264471 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:00:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-85452151-ea08-4b9f-858a-3ff3e5779282 req-e26a77c5-22ca-4b64-a908-8e95f5264471 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '477f0e96-91b9-463a-9d84-e3fa252ccb14', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:00:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-85452151-ea08-4b9f-858a-3ff3e5779282 req-e26a77c5-22ca-4b64-a908-8e95f5264471 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] attachment_update completed successfully. Sep 09 17:00:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-cd7bfa20-2093-43e2-ae37-1ee13b0f4bb7 req-cdd90cd6-b9a5-4e78-b3c3-79fd0f26ac66 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Terminate volume connection completed successfully. Sep 09 17:00:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-cd7bfa20-2093-43e2-ae37-1ee13b0f4bb7 req-cdd90cd6-b9a5-4e78-b3c3-79fd0f26ac66 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Deleting attachment 477f0e96-91b9-463a-9d84-e3fa252ccb14. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:00:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Acquiring lock "cinder-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:00:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "cinder-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:00:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Acquiring lock "cinder-quobyte-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:00:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "cinder-quobyte-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:00:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[798d0d09-8337-4b2d-b85d-854d010aa3f2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:00:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:00:39 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca Sep 09 17:00:39 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:40 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca" returned: 0 in 0.403s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:00:40 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca Sep 09 17:00:40 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:40 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "cinder-quobyte-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca" released by "delete_volume" :: held 0.699s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Created reservations ['0ca00f17-7ee2-4791-abdd-027b7ae24729', '1bff4d47-8f45-428c-b275-a9d14ba76404', 'fd4633f0-947c-4c8b-98c1-b8ae3c12037a', '2f49c46f-394a-4d2a-998b-1626badacc16'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:00:40 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:00:40 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:40 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.291s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:00:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Deleted volume successfully. Sep 09 17:00:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ca54538e-80cc-4ad1-82d9-54058e06cee7 tempest-TestServerVolumeAttachScenarioOldVersion-643934715 None] Lock "cinder-149e8cc7-6ec9-4574-ba27-b3ecb40b93ca-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:00:45 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:00:45 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:00:45 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.289s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:00:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:00:50 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=20,cinder:SELECT=16,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:00:50 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=24,cinder:INSERT=5,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Flow 'volume_create_manager' (7995febc-1b69-45a1-a69e-6880de9175e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c9ad4c-24b8-49f0-8534-cdc202d23254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05c9ad4c-24b8-49f0-8534-cdc202d23254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-264288215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce8085c-abe7-42e0-a460-012fbb6fe50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51d732ef5bc42908d8bd9d086a97320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:01:04Z,use_quota=True,user_id='d8d62129463341b7a65a0f4338b22995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bca5fee-4d34-4772-9f35-5877bf025a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bca5fee-4d34-4772-9f35-5877bf025a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d90031-1962-41c8-a802-8aa01ddaf310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3d90031-1962-41c8-a802-8aa01ddaf310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fce8085c-abe7-42e0-a460-012fbb6fe50c', 'volume_name': 'volume-fce8085c-abe7-42e0-a460-012fbb6fe50c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7bc374-671b-454b-a352-2fcc3f3fd293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7bc374-671b-454b-a352-2fcc3f3fd293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc20ec88-33dc-4984-8eaa-2c928d9a7b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Volume fce8085c-abe7-42e0-a460-012fbb6fe50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fce8085c-abe7-42e0-a460-012fbb6fe50c', 'volume_size': 1} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:01:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-264288215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce8085c-abe7-42e0-a460-012fbb6fe50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51d732ef5bc42908d8bd9d086a97320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:01:04Z,use_quota=True,user_id='d8d62129463341b7a65a0f4338b22995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Creating volume fce8085c-abe7-42e0-a460-012fbb6fe50c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:01:04 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:04 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c 1073741824 Sep 09 17:01:04 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:04 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c 1073741824" returned: 0 in 0.524s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:04 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c Sep 09 17:01:04 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:05 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c" returned: 0 in 0.314s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:01:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc20ec88-33dc-4984-8eaa-2c928d9a7b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fce8085c-abe7-42e0-a460-012fbb6fe50c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2958b1-667b-4a6f-884d-c12ed0e5a4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Volume volume-fce8085c-abe7-42e0-a460-012fbb6fe50c (fce8085c-abe7-42e0-a460-012fbb6fe50c): created successfully Sep 09 17:01:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2958b1-667b-4a6f-884d-c12ed0e5a4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Flow 'volume_create_manager' (7995febc-1b69-45a1-a69e-6880de9175e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:01:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-baf63a58-e8d2-4d31-bb67-b0f5abd1fb88 tempest-TestStampPattern-718821306 None] Created volume successfully. Sep 09 17:01:15 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:INSERT=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:01:15 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Flow 'volume_create_manager' (cf3c02f8-5071-49d7-92c9-b9eafef846f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5954b9be-b37c-4781-80d3-d887c22272ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5954b9be-b37c-4781-80d3-d887c22272ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1948021362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab748f7e-02b1-4137-acb3-8529f71885bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee3691c30e14fb4ba56169aded24323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:01:24Z,use_quota=True,user_id='5671738bb70b4f4b8582fc4b20a6814f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef69fb92-3148-439d-b0fd-b5b6f6110834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef69fb92-3148-439d-b0fd-b5b6f6110834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2980a09a-05e8-4f41-80e4-105b11e27863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2980a09a-05e8-4f41-80e4-105b11e27863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab748f7e-02b1-4137-acb3-8529f71885bc', 'volume_name': 'volume-ab748f7e-02b1-4137-acb3-8529f71885bc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272dd169-aebe-42e1-8b11-95794e1c75f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (272dd169-aebe-42e1-8b11-95794e1c75f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7834273b-dfd4-4c95-a510-5850be5c4363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Volume ab748f7e-02b1-4137-acb3-8529f71885bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab748f7e-02b1-4137-acb3-8529f71885bc', 'volume_size': 1} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1948021362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab748f7e-02b1-4137-acb3-8529f71885bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee3691c30e14fb4ba56169aded24323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:01:24Z,use_quota=True,user_id='5671738bb70b4f4b8582fc4b20a6814f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Creating volume ab748f7e-02b1-4137-acb3-8529f71885bc {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:01:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:24 devstack sudo[104660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc 1073741824 Sep 09 17:01:24 devstack sudo[104660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Flow 'volume_create_manager' (09e9522c-193f-4e4e-a172-bde6e946bc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6a8ef0-8c76-49f5-9dc2-38d77a68c80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff6a8ef0-8c76-49f5-9dc2-38d77a68c80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-312554307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743209e7-221a-4f8b-b7a0-c15aeb5e2bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee3691c30e14fb4ba56169aded24323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:01:25Z,use_quota=True,user_id='5671738bb70b4f4b8582fc4b20a6814f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328107a6-f6b3-4839-b342-7aa6b2bfec8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (328107a6-f6b3-4839-b342-7aa6b2bfec8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b018514f-bcc1-4b7a-abef-d996457c06e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b018514f-bcc1-4b7a-abef-d996457c06e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743209e7-221a-4f8b-b7a0-c15aeb5e2bde', 'volume_name': 'volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc37c95-3a06-41e3-92a0-415a1d7091ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc37c95-3a06-41e3-92a0-415a1d7091ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab982d9c-efb8-4462-adf7-74ce5346b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Volume 743209e7-221a-4f8b-b7a0-c15aeb5e2bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde', 'volume_size': 1} Sep 09 17:01:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:25 devstack sudo[104660]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc 1073741824" returned: 0 in 0.498s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:25 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc Sep 09 17:01:25 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:25 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.416s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-312554307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743209e7-221a-4f8b-b7a0-c15aeb5e2bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ee3691c30e14fb4ba56169aded24323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:01:25Z,use_quota=True,user_id='5671738bb70b4f4b8582fc4b20a6814f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Creating volume 743209e7-221a-4f8b-b7a0-c15aeb5e2bde {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:01:25 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7834273b-dfd4-4c95-a510-5850be5c4363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab748f7e-02b1-4137-acb3-8529f71885bc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e4631a-f21d-4efa-bd88-bdd069392082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:25 devstack sudo[104670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde 1073741824 Sep 09 17:01:25 devstack sudo[104670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:25 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Volume volume-ab748f7e-02b1-4137-acb3-8529f71885bc (ab748f7e-02b1-4137-acb3-8529f71885bc): created successfully Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98e4631a-f21d-4efa-bd88-bdd069392082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Flow 'volume_create_manager' (cf3c02f8-5071-49d7-92c9-b9eafef846f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:01:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7e48c179-eb1f-4890-96e9-6e332bebee04 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Created volume successfully. Sep 09 17:01:25 devstack sudo[104670]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde 1073741824" returned: 0 in 0.464s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:25 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde Sep 09 17:01:25 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:26 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:01:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab982d9c-efb8-4462-adf7-74ce5346b884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c85314-e588-4985-a33a-8e4508f87b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Volume volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde (743209e7-221a-4f8b-b7a0-c15aeb5e2bde): created successfully Sep 09 17:01:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7c85314-e588-4985-a33a-8e4508f87b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Flow 'volume_create_manager' (09e9522c-193f-4e4e-a172-bde6e946bc07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:01:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2d628482-22e8-4956-9a6a-fc34ed760de2 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Created volume successfully. Sep 09 17:01:36 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=5,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:01:36 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=7,cinder:SELECT=3,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:01:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-7f74ab39-562c-4aab-ab4f-4632784a7df2 req-cce02991-a537-43b0-b761-512fad6b1636 tempest-TestStampPattern-718821306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-7f74ab39-562c-4aab-ab4f-4632784a7df2 req-cce02991-a537-43b0-b761-512fad6b1636 tempest-TestStampPattern-718821306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-7f74ab39-562c-4aab-ab4f-4632784a7df2 req-cce02991-a537-43b0-b761-512fad6b1636 tempest-TestStampPattern-718821306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-7f74ab39-562c-4aab-ab4f-4632784a7df2 req-cce02991-a537-43b0-b761-512fad6b1636 tempest-TestStampPattern-718821306 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-fce8085c-abe7-42e0-a460-012fbb6fe50c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c2e1f69d-402d-4860-85c1-45e80fae87e3', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:01:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-7f74ab39-562c-4aab-ab4f-4632784a7df2 req-cce02991-a537-43b0-b761-512fad6b1636 tempest-TestStampPattern-718821306 None] attachment_update completed successfully. Sep 09 17:01:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-9d03c41f-4803-42fc-b129-c3d66a1e133f req-7328aa9a-ecb9-4f9c-b029-a9610f0deb9f tempest-TestStampPattern-718821306 None] Terminate volume connection completed successfully. Sep 09 17:01:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-9d03c41f-4803-42fc-b129-c3d66a1e133f req-7328aa9a-ecb9-4f9c-b029-a9610f0deb9f tempest-TestStampPattern-718821306 None] Deleting attachment c2e1f69d-402d-4860-85c1-45e80fae87e3. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:01:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Creating offline snapshot f2af771a-0a09-4e16-9399-6d0f947304ab of volume fce8085c-abe7-42e0-a460-012fbb6fe50c {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:01:43 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4678f84c-88f4-45e2-ade7-7d6646575994]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:43 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c Sep 09 17:01:43 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:43 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c" returned: 0 in 0.391s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:43 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab 1G Sep 09 17:01:43 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:43 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab 1G" returned: 0 in 0.446s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fce8085c-abe7-42e0-a460-012fbb6fe50c -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:43 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fce8085c-abe7-42e0-a460-012fbb6fe50c -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab Sep 09 17:01:43 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:44 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fce8085c-abe7-42e0-a460-012fbb6fe50c -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:44 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab is being set with open permissions: ugo+rw Sep 09 17:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:44 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab Sep 09 17:01:44 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:44 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab" returned: 0 in 0.284s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:44 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.info Sep 09 17:01:44 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:44 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.info" returned: 0 in 0.284s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:44 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.info is being set with open permissions: ugo+rw Sep 09 17:01:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:44 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.info Sep 09 17:01:44 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:45 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.info" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bc3bc07f-faec-4d36-9e4e-a4f746e2675c tempest-TestStampPattern-718821306 None] Create snapshot completed successfully Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:45 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:01:45 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:45 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:01:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Flow 'volume_create_manager' (97b60b55-425b-4b8e-9a49-827bd01f224f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8343856-b291-4527-b3ba-52626f37cfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8343856-b291-4527-b3ba-52626f37cfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1411838686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d131d8-8af2-4c71-9f3c-32c00c532771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d51d732ef5bc42908d8bd9d086a97320',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f2af771a-0a09-4e16-9399-6d0f947304ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:01:53Z,use_quota=True,user_id='d8d62129463341b7a65a0f4338b22995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7964dae-f5e3-455b-9828-2285f3f1a7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7964dae-f5e3-455b-9828-2285f3f1a7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5946271-400e-42f0-a3a2-d2b5d8d63d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5946271-400e-42f0-a3a2-d2b5d8d63d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f0d131d8-8af2-4c71-9f3c-32c00c532771', 'volume_name': 'volume-f0d131d8-8af2-4c71-9f3c-32c00c532771', 'volume_size': 1, 'snapshot_id': 'f2af771a-0a09-4e16-9399-6d0f947304ab'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500f1995-77b3-4455-9aba-d880f2062c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (500f1995-77b3-4455-9aba-d880f2062c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d9cbd8-f005-47f9-a026-bcce904fb107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:01:53 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Volume f0d131d8-8af2-4c71-9f3c-32c00c532771: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f0d131d8-8af2-4c71-9f3c-32c00c532771', 'volume_size': 1, 'snapshot_id': 'f2af771a-0a09-4e16-9399-6d0f947304ab'} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Acquiring lock "cinder-quobyte-f2af771a-0a09-4e16-9399-6d0f947304ab-f0d131d8-8af2-4c71-9f3c-32c00c532771" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-f2af771a-0a09-4e16-9399-6d0f947304ab-f0d131d8-8af2-4c71-9f3c-32c00c532771" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Creating volume f0d131d8-8af2-4c71-9f3c-32c00c532771 from snapshot f2af771a-0a09-4e16-9399-6d0f947304ab {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Acquiring lock "cinder-quobyte-f0d131d8-8af2-4c71-9f3c-32c00c532771" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-f0d131d8-8af2-4c71-9f3c-32c00c532771" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] snapshot: f2af771a-0a09-4e16-9399-6d0f947304ab, volume: f0d131d8-8af2-4c71-9f3c-32c00c532771, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1de43f-dcf9-455d-b135-da15e5465e7b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:53 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab Sep 09 17:01:53 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:53 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fce8085c-abe7-42e0-a460-012fbb6fe50c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e68f7f-00b6-4eb6-8258-64107e8e7706]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:53 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c Sep 09 17:01:53 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:53 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 09 17:01:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c" returned: 0 in 0.433s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:01:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:01:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:01:54 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:01:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:01:54 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 Sep 09 17:01:54 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:01:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0b69714d-ec5e-4b01-9433-f5d3737419d2 req-74d4de33-5990-4ec3-bc01-8a108235bed7 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:00 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771" returned: 0 in 6.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:02:00 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Converted 1024.00 MB image at 160.36 MB/s Sep 09 17:02:00 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 is being set with open permissions: ugo+rw Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:00 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 Sep 09 17:02:00 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:00 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771" returned: 0 in 0.291s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-f0d131d8-8af2-4c71-9f3c-32c00c532771" released by "_copy_volume_from_snapshot" :: held 7.643s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-f2af771a-0a09-4e16-9399-6d0f947304ab-f0d131d8-8af2-4c71-9f3c-32c00c532771" released by "_create_volume_from_snapshot" :: held 7.716s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.732s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0b69714d-ec5e-4b01-9433-f5d3737419d2 req-74d4de33-5990-4ec3-bc01-8a108235bed7 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.734s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-0b69714d-ec5e-4b01-9433-f5d3737419d2 req-74d4de33-5990-4ec3-bc01-8a108235bed7 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3d9cbd8-f005-47f9-a026-bcce904fb107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d131d8-8af2-4c71-9f3c-32c00c532771', 'volume_size': 1, 'snapshot_id': 'f2af771a-0a09-4e16-9399-6d0f947304ab'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbb09ae-c6f5-403b-83cf-ccc4b798baf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Volume volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 (f0d131d8-8af2-4c71-9f3c-32c00c532771): created successfully Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efbb09ae-c6f5-403b-83cf-ccc4b798baf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Flow 'volume_create_manager' (97b60b55-425b-4b8e-9a49-827bd01f224f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-0b69714d-ec5e-4b01-9433-f5d3737419d2 req-74d4de33-5990-4ec3-bc01-8a108235bed7 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-ab748f7e-02b1-4137-acb3-8529f71885bc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0dc68dc0-aca1-45e7-b2ab-a83d710a9073', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:02:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0dbd417b-caaa-48e5-8c82-974e9b8eb385 tempest-TestStampPattern-718821306 None] Created volume successfully. Sep 09 17:02:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-0b69714d-ec5e-4b01-9433-f5d3737419d2 req-74d4de33-5990-4ec3-bc01-8a108235bed7 tempest-TestServerVolumeAttachmentScenario-2126784807 None] attachment_update completed successfully. Sep 09 17:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-5e4c4218-2088-45be-820c-7e8a56a462fc req-b2b5aaf0-dfba-4657-a2d4-621a8c574553 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-5e4c4218-2088-45be-820c-7e8a56a462fc req-b2b5aaf0-dfba-4657-a2d4-621a8c574553 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-5e4c4218-2088-45be-820c-7e8a56a462fc req-b2b5aaf0-dfba-4657-a2d4-621a8c574553 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-5e4c4218-2088-45be-820c-7e8a56a462fc req-b2b5aaf0-dfba-4657-a2d4-621a8c574553 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b1178228-2911-4f0d-8e65-dad18711c186', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:02:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-5e4c4218-2088-45be-820c-7e8a56a462fc req-b2b5aaf0-dfba-4657-a2d4-621a8c574553 tempest-TestServerVolumeAttachmentScenario-2126784807 None] attachment_update completed successfully. Sep 09 17:02:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-50c9fe16-36ce-4586-b915-364e7dcbd788 req-974d8f53-55f4-4b0d-8f37-9d368ffef4dc tempest-TestServerVolumeAttachmentScenario-2126784807 None] Terminate volume connection completed successfully. Sep 09 17:02:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-50c9fe16-36ce-4586-b915-364e7dcbd788 req-974d8f53-55f4-4b0d-8f37-9d368ffef4dc tempest-TestServerVolumeAttachmentScenario-2126784807 None] Deleting attachment b1178228-2911-4f0d-8e65-dad18711c186. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:02:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-6d49dac5-4122-4e1f-9dd5-e54bf587ad3f req-6efea922-0aca-4efa-917e-8b80721b7f9a tempest-TestServerVolumeAttachmentScenario-2126784807 None] Terminate volume connection completed successfully. Sep 09 17:02:09 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-6d49dac5-4122-4e1f-9dd5-e54bf587ad3f req-6efea922-0aca-4efa-917e-8b80721b7f9a tempest-TestServerVolumeAttachmentScenario-2126784807 None] Deleting attachment 0dc68dc0-aca1-45e7-b2ab-a83d710a9073. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:02:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "cinder-743209e7-221a-4f8b-b7a0-c15aeb5e2bde-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "cinder-743209e7-221a-4f8b-b7a0-c15aeb5e2bde-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "cinder-quobyte-743209e7-221a-4f8b-b7a0-c15aeb5e2bde" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "cinder-quobyte-743209e7-221a-4f8b-b7a0-c15aeb5e2bde" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb23420d-ed05-4f26-a1f2-0d8a6183461c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:14 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde Sep 09 17:02:14 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:14 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde" returned: 0 in 0.361s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:14 devstack sudo[105902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde Sep 09 17:02:14 devstack sudo[105902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:14 devstack sudo[105902]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-743209e7-221a-4f8b-b7a0-c15aeb5e2bde" returned: 0 in 0.304s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "cinder-quobyte-743209e7-221a-4f8b-b7a0-c15aeb5e2bde" released by "delete_volume" :: held 0.714s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Created reservations ['65deaec0-4e6a-4a22-ac16-fb3880872746', '1676b8e6-4d63-4cee-88de-5fc25c00a447', '9718e328-ad19-4d30-8083-b3ef86cfb0d8', '108e3cf2-a5ab-47ce-be31-bbf4476153d7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:14 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:14 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:14 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "cinder-ab748f7e-02b1-4137-acb3-8529f71885bc-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Deleted volume successfully. Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "cinder-ab748f7e-02b1-4137-acb3-8529f71885bc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e8ea8b5e-55ee-46aa-bfe5-3b39098f8caa tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "cinder-743209e7-221a-4f8b-b7a0-c15aeb5e2bde-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "cinder-quobyte-ab748f7e-02b1-4137-acb3-8529f71885bc" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "cinder-quobyte-ab748f7e-02b1-4137-acb3-8529f71885bc" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ee85c2-b509-4793-8cfa-bdc23fecbb80]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:15 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc Sep 09 17:02:15 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:15 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:15 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc Sep 09 17:02:15 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:15 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ab748f7e-02b1-4137-acb3-8529f71885bc" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "cinder-quobyte-ab748f7e-02b1-4137-acb3-8529f71885bc" released by "delete_volume" :: held 0.692s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Created reservations ['0881d1e2-0190-42be-83b1-f4febbe0a7f8', 'ebe05e74-9373-4381-a753-23dcbeca502c', '6fe444d8-ee4d-43d8-af4a-965ea72c14f1', 'c130804e-8b6b-4711-b8c8-8d10d9e3d234'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:15 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:15 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:16 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:16 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Deleted volume successfully. Sep 09 17:02:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5ad6c118-cf34-4677-9368-cccf772f49c4 tempest-TestServerVolumeAttachmentScenario-2126784807 None] Lock "cinder-ab748f7e-02b1-4137-acb3-8529f71885bc-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:25 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=33,cinder:UPDATE=27,cinder:INSERT=6 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:02:26 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=47,cinder:UPDATE=24,cinder:DELETE=4,cinder:INSERT=4 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Flow 'volume_create_manager' (9dad6ef6-5013-4ade-b1eb-f2a9ead6b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9aa3f3-edc0-4976-99dc-1ed349e509e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c9aa3f3-edc0-4976-99dc-1ed349e509e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-917877258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6550c9c0-53c6-4cbd-8336-6789b6e32592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b53dbca7024de9bc1f673b9ac269eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:28Z,use_quota=True,user_id='6372ac4703e8407e82c9abb3218a3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e777a2-6206-4fee-9925-50b92075767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72e777a2-6206-4fee-9925-50b92075767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09212f5-fefc-4bc1-ad41-5a70c97d1b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09212f5-fefc-4bc1-ad41-5a70c97d1b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6550c9c0-53c6-4cbd-8336-6789b6e32592', 'volume_name': 'volume-6550c9c0-53c6-4cbd-8336-6789b6e32592', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e780a6-6877-4408-954e-b65c111a583c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19e780a6-6877-4408-954e-b65c111a583c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3c0dcb-8816-4c65-b806-581bb4d153dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Volume 6550c9c0-53c6-4cbd-8336-6789b6e32592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6550c9c0-53c6-4cbd-8336-6789b6e32592', 'volume_size': 1} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-917877258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6550c9c0-53c6-4cbd-8336-6789b6e32592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b53dbca7024de9bc1f673b9ac269eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:28Z,use_quota=True,user_id='6372ac4703e8407e82c9abb3218a3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Creating volume 6550c9c0-53c6-4cbd-8336-6789b6e32592 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:02:27 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:27 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592 1073741824 Sep 09 17:02:27 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:02:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Flow 'volume_create_manager' (c3c9aec3-954f-4d0a-9d32-ba4e48d9478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bed6c7-1e4e-49f6-975b-eeb4ed375f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bed6c7-1e4e-49f6-975b-eeb4ed375f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-609556574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096f4e8b-0fa3-4746-8a47-941c88b0f594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b53dbca7024de9bc1f673b9ac269eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:28Z,use_quota=True,user_id='6372ac4703e8407e82c9abb3218a3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa95f80-5500-4534-ab67-f63c27d6b6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa95f80-5500-4534-ab67-f63c27d6b6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17879b9-8ac0-4a62-afde-f576832e5b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17879b9-8ac0-4a62-afde-f576832e5b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '096f4e8b-0fa3-4746-8a47-941c88b0f594', 'volume_name': 'volume-096f4e8b-0fa3-4746-8a47-941c88b0f594', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f180653-3c40-4c64-bd75-b7ce0aa25a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f180653-3c40-4c64-bd75-b7ce0aa25a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e18cc3-a748-4e6f-8e35-f3ccc6ce4e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Volume 096f4e8b-0fa3-4746-8a47-941c88b0f594: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-096f4e8b-0fa3-4746-8a47-941c88b0f594', 'volume_size': 1} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:28 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592 1073741824" returned: 0 in 0.550s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:28 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592 Sep 09 17:02:28 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Flow 'volume_create_manager' (cc511255-b2bf-42c5-9ec7-e5e6d0dbc0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef2a17d-b8af-4835-9acb-92358f247e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef2a17d-b8af-4835-9acb-92358f247e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356073690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207a9269-f55e-4760-832f-92c489ef6271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b53dbca7024de9bc1f673b9ac269eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:28Z,use_quota=True,user_id='6372ac4703e8407e82c9abb3218a3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3facecb-e046-4f05-9a81-89a5c0c1cfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3facecb-e046-4f05-9a81-89a5c0c1cfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e350a72a-d4fb-45c6-bb61-75d782b42c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e350a72a-d4fb-45c6-bb61-75d782b42c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '207a9269-f55e-4760-832f-92c489ef6271', 'volume_name': 'volume-207a9269-f55e-4760-832f-92c489ef6271', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333de04b-2dcb-4293-b87c-575c0d1e9aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (333de04b-2dcb-4293-b87c-575c0d1e9aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a595dc9-4c81-4e9a-9777-ac2460e7595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Volume 207a9269-f55e-4760-832f-92c489ef6271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-207a9269-f55e-4760-832f-92c489ef6271', 'volume_size': 1} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.617s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-609556574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=096f4e8b-0fa3-4746-8a47-941c88b0f594,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b53dbca7024de9bc1f673b9ac269eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:28Z,use_quota=True,user_id='6372ac4703e8407e82c9abb3218a3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Creating volume 096f4e8b-0fa3-4746-8a47-941c88b0f594 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:02:28 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:28 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594 1073741824 Sep 09 17:02:28 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3c0dcb-8816-4c65-b806-581bb4d153dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6550c9c0-53c6-4cbd-8336-6789b6e32592', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9fd30f-7780-4d9e-858b-8abb726f6ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Volume volume-6550c9c0-53c6-4cbd-8336-6789b6e32592 (6550c9c0-53c6-4cbd-8336-6789b6e32592): created successfully Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff9fd30f-7780-4d9e-858b-8abb726f6ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Flow 'volume_create_manager' (9dad6ef6-5013-4ade-b1eb-f2a9ead6b713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d81cf51b-32af-4cd4-a59b-26337aa23b2c tempest-CreateVolumesFromImageTest-921993900 None] Created volume successfully. Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Flow 'volume_create_manager' (db37ca64-9e08-4643-b954-781428e0c76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab6d4b6-079a-4189-8f24-b95387034b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ab6d4b6-079a-4189-8f24-b95387034b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1346357597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42dabe96-e41f-4439-a8f8-022183a6e9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b53dbca7024de9bc1f673b9ac269eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:29Z,use_quota=True,user_id='6372ac4703e8407e82c9abb3218a3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4975bb9-9646-411b-8ce1-6aa0a1fede75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4975bb9-9646-411b-8ce1-6aa0a1fede75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd4d2a5-2b13-4015-96dd-6c05e02caabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd4d2a5-2b13-4015-96dd-6c05e02caabe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42dabe96-e41f-4439-a8f8-022183a6e9fe', 'volume_name': 'volume-42dabe96-e41f-4439-a8f8-022183a6e9fe', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04aa7f2b-61da-4c86-971e-3ab1332068f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04aa7f2b-61da-4c86-971e-3ab1332068f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306bf7d5-911c-4852-80f3-f168d920a01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Volume 42dabe96-e41f-4439-a8f8-022183a6e9fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42dabe96-e41f-4439-a8f8-022183a6e9fe', 'volume_size': 1} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Flow 'volume_create_manager' (ba0324b5-5724-4c02-9694-b5cfb8412982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0415ec04-e02a-4614-af79-35e62486984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0415ec04-e02a-4614-af79-35e62486984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419718870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0289598-a74c-41d9-8a4b-e4d9b82e3dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b53dbca7024de9bc1f673b9ac269eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:29Z,use_quota=True,user_id='6372ac4703e8407e82c9abb3218a3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d622d1d9-8ddb-42d6-8664-fc719678df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d622d1d9-8ddb-42d6-8664-fc719678df48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d07e9b2-1cf7-404c-bdab-95ea8d589e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d07e9b2-1cf7-404c-bdab-95ea8d589e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0289598-a74c-41d9-8a4b-e4d9b82e3dd9', 'volume_name': 'volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197ee6b8-b820-4981-8ef3-2c9445ce87b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (197ee6b8-b820-4981-8ef3-2c9445ce87b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4869f25-dd46-4e46-9127-a505806fe94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Volume e0289598-a74c-41d9-8a4b-e4d9b82e3dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9', 'volume_size': 1} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594 1073741824" returned: 0 in 0.827s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:29 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594 Sep 09 17:02:29 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:29 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.175s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-356073690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=207a9269-f55e-4760-832f-92c489ef6271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b53dbca7024de9bc1f673b9ac269eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:28Z,use_quota=True,user_id='6372ac4703e8407e82c9abb3218a3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Creating volume 207a9269-f55e-4760-832f-92c489ef6271 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:02:29 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4e18cc3-a748-4e6f-8e35-f3ccc6ce4e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-096f4e8b-0fa3-4746-8a47-941c88b0f594', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ff0eb0-5633-4762-8955-b01a17b121c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:29 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271 1073741824 Sep 09 17:02:29 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Volume volume-096f4e8b-0fa3-4746-8a47-941c88b0f594 (096f4e8b-0fa3-4746-8a47-941c88b0f594): created successfully Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ff0eb0-5633-4762-8955-b01a17b121c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Flow 'volume_create_manager' (c3c9aec3-954f-4d0a-9d32-ba4e48d9478d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9b4f9816-f76f-4fc4-b841-472a50327684 tempest-CreateVolumesFromImageTest-921993900 None] Created volume successfully. Sep 09 17:02:30 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271 1073741824" returned: 0 in 0.426s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:30 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271 Sep 09 17:02:30 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:30 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.721s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.442s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1346357597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42dabe96-e41f-4439-a8f8-022183a6e9fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b53dbca7024de9bc1f673b9ac269eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:29Z,use_quota=True,user_id='6372ac4703e8407e82c9abb3218a3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Creating volume 42dabe96-e41f-4439-a8f8-022183a6e9fe {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:02:30 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:30 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe 1073741824 Sep 09 17:02:30 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a595dc9-4c81-4e9a-9777-ac2460e7595f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-207a9269-f55e-4760-832f-92c489ef6271', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f0bd24-fa1e-442f-8cae-7461b944d9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:30 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Volume volume-207a9269-f55e-4760-832f-92c489ef6271 (207a9269-f55e-4760-832f-92c489ef6271): created successfully Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f0bd24-fa1e-442f-8cae-7461b944d9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:30 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Flow 'volume_create_manager' (cc511255-b2bf-42c5-9ec7-e5e6d0dbc0f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6671a89a-ae1b-464a-8e9a-3e987cbd4c26 tempest-CreateVolumesFromImageTest-921993900 None] Created volume successfully. Sep 09 17:02:31 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe 1073741824" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:31 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe Sep 09 17:02:31 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:31 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] <== create_volume: return (690ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.740s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419718870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0289598-a74c-41d9-8a4b-e4d9b82e3dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44b53dbca7024de9bc1f673b9ac269eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:29Z,use_quota=True,user_id='6372ac4703e8407e82c9abb3218a3656',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Creating volume e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:02:31 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (306bf7d5-911c-4852-80f3-f168d920a01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42dabe96-e41f-4439-a8f8-022183a6e9fe', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec690019-bbe7-4de8-8a0a-bf373dc5d7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:31 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 1073741824 Sep 09 17:02:31 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:31 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Volume volume-42dabe96-e41f-4439-a8f8-022183a6e9fe (42dabe96-e41f-4439-a8f8-022183a6e9fe): created successfully Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec690019-bbe7-4de8-8a0a-bf373dc5d7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Flow 'volume_create_manager' (db37ca64-9e08-4643-b954-781428e0c76b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-feae95bb-dac4-4614-8168-c0bd04da8d1e tempest-CreateVolumesFromImageTest-921993900 None] Created volume successfully. Sep 09 17:02:31 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 1073741824" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:31 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 Sep 09 17:02:31 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:31 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:31 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4869f25-dd46-4e46-9127-a505806fe94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c18106-de3a-45d5-9996-b37f928c6a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:32 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Volume volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 (e0289598-a74c-41d9-8a4b-e4d9b82e3dd9): created successfully Sep 09 17:02:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03c18106-de3a-45d5-9996-b37f928c6a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:32 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Flow 'volume_create_manager' (ba0324b5-5724-4c02-9694-b5cfb8412982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:32 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1eefcc62-f100-48bb-b7bd-33e845e91180 tempest-CreateVolumesFromImageTest-921993900 None] Created volume successfully. Sep 09 17:02:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "cinder-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "cinder-quobyte-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-quobyte-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f206b1c9-caf6-443c-8304-d29360bef29a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:32 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 Sep 09 17:02:32 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:33 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:33 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9 Sep 09 17:02:33 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:33 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-quobyte-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9" released by "delete_volume" :: held 0.653s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Created reservations ['ec5cfda8-d787-44c9-b64f-2701eb098e06', '1578d8af-260e-48cf-a00b-3f0b90274e96', '5ba62cb9-4c14-49f5-a951-f274a1a99009', '7bc6a072-b43d-428f-9757-04098962bd93'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:33 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:33 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:33 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Deleted volume successfully. Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4ead9654-b395-4927-8af0-736ea0098a0a tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-e0289598-a74c-41d9-8a4b-e4d9b82e3dd9-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "cinder-42dabe96-e41f-4439-a8f8-022183a6e9fe-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-42dabe96-e41f-4439-a8f8-022183a6e9fe-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "cinder-quobyte-42dabe96-e41f-4439-a8f8-022183a6e9fe" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-quobyte-42dabe96-e41f-4439-a8f8-022183a6e9fe" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[da720fcd-1725-4146-b3a7-4dbd99c665f6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:34 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe Sep 09 17:02:34 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:34 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:34 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe Sep 09 17:02:34 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:34 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-42dabe96-e41f-4439-a8f8-022183a6e9fe" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-quobyte-42dabe96-e41f-4439-a8f8-022183a6e9fe" released by "delete_volume" :: held 0.657s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Created reservations ['09474729-db8d-47cb-be99-edcef5fed7f5', 'cd76b1fc-2a97-4e61-bbfd-63a2b4c23aab', '0e34ebbc-1a95-49ac-a123-c17d51f9bae1', '920bf081-092a-4fab-af36-013ec08f1fe8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:34 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:34 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:35 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Deleted volume successfully. Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-17c4ee75-190d-4f15-a5ad-a3d5a7bff89b tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-42dabe96-e41f-4439-a8f8-022183a6e9fe-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "cinder-207a9269-f55e-4760-832f-92c489ef6271-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-207a9269-f55e-4760-832f-92c489ef6271-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "cinder-quobyte-207a9269-f55e-4760-832f-92c489ef6271" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-quobyte-207a9269-f55e-4760-832f-92c489ef6271" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f3d31f-6dfd-4447-9562-23fbb8f1b919]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:35 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271 Sep 09 17:02:35 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:35 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:35 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271 Sep 09 17:02:35 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:35 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-207a9269-f55e-4760-832f-92c489ef6271" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-quobyte-207a9269-f55e-4760-832f-92c489ef6271" released by "delete_volume" :: held 0.689s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Created reservations ['2e84952e-cb3f-4c07-83b7-ab5657a13d67', 'd8e52873-5adc-4a0d-8cc1-e4ee3c3f0fbe', '64e1e99c-0b2d-46d2-a648-ecac32ea4d31', '4ae460eb-3c46-4b71-b4cb-e5fca2035dab'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:36 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:36 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:36 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Deleted volume successfully. Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "cinder-096f4e8b-0fa3-4746-8a47-941c88b0f594-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-096f4e8b-0fa3-4746-8a47-941c88b0f594-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-26d4e614-e090-4336-b375-29020a42c259 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-207a9269-f55e-4760-832f-92c489ef6271-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "cinder-quobyte-096f4e8b-0fa3-4746-8a47-941c88b0f594" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-quobyte-096f4e8b-0fa3-4746-8a47-941c88b0f594" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4c7b57-c21f-4707-a6a4-1d1ddddf10fe]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:36 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594 Sep 09 17:02:36 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:36 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:36 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594 Sep 09 17:02:36 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:36 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-096f4e8b-0fa3-4746-8a47-941c88b0f594" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-quobyte-096f4e8b-0fa3-4746-8a47-941c88b0f594" released by "delete_volume" :: held 0.660s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Created reservations ['e431b023-c09c-4dfd-977f-6c7fa548189f', '8419f469-76ae-4e9b-b15b-046631c34374', '8c2ff077-113b-41f9-b79d-f1f14f8d399b', 'e4fb82fb-2296-4c6d-9633-8a1ae4ff7938'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:37 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:37 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:37 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Deleted volume successfully. Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6c213cee-5f52-4c1d-983b-0248f230bf83 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-096f4e8b-0fa3-4746-8a47-941c88b0f594-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "cinder-6550c9c0-53c6-4cbd-8336-6789b6e32592-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-6550c9c0-53c6-4cbd-8336-6789b6e32592-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "cinder-quobyte-6550c9c0-53c6-4cbd-8336-6789b6e32592" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-quobyte-6550c9c0-53c6-4cbd-8336-6789b6e32592" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b424cef7-263a-4d1e-910e-500a92d78b46]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:37 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592 Sep 09 17:02:37 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:37 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:37 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592 Sep 09 17:02:37 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:38 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6550c9c0-53c6-4cbd-8336-6789b6e32592" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-quobyte-6550c9c0-53c6-4cbd-8336-6789b6e32592" released by "delete_volume" :: held 0.634s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Created reservations ['49d595d5-dd6e-46c5-89d4-67bd09c7b23a', 'd8b48aae-3c19-47aa-9152-e45c7c50d225', 'a9087557-670a-4d34-a418-cf8914592077', '4ff88300-50db-4c51-9e41-8850b4557b70'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:38 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:38 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:38 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Deleted volume successfully. Sep 09 17:02:38 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-ed967916-e2bb-42b1-a76d-5e6c02122fa4 tempest-CreateVolumesFromImageTest-921993900 None] Lock "cinder-6550c9c0-53c6-4cbd-8336-6789b6e32592-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Flow 'volume_create_manager' (a63e0aad-5689-482b-8f3d-9aaef934d596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef38d45-0686-4022-9c34-82381f3a2857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef38d45-0686-4022-9c34-82381f3a2857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1755632041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85190fb-98f6-4db4-bd39-32053e633290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4427398a3c9740bf8b2af99f6ca5de47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:41Z,use_quota=True,user_id='5072611351954e3997c2730721ef5ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcf214b-16b5-4c90-bd5d-ccf6ae4d39dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfcf214b-16b5-4c90-bd5d-ccf6ae4d39dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf75597e-9563-4cb7-8373-0be933ca1bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf75597e-9563-4cb7-8373-0be933ca1bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85190fb-98f6-4db4-bd39-32053e633290', 'volume_name': 'volume-a85190fb-98f6-4db4-bd39-32053e633290', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d86051-a656-4022-98af-be21a6ad54d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3d86051-a656-4022-98af-be21a6ad54d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49d421a-f43b-4511-a3de-60cc76889d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:41 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Volume a85190fb-98f6-4db4-bd39-32053e633290: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85190fb-98f6-4db4-bd39-32053e633290', 'volume_size': 1} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1755632041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85190fb-98f6-4db4-bd39-32053e633290,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4427398a3c9740bf8b2af99f6ca5de47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:41Z,use_quota=True,user_id='5072611351954e3997c2730721ef5ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Creating volume a85190fb-98f6-4db4-bd39-32053e633290 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:02:41 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:41 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 1073741824 Sep 09 17:02:41 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:41 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 1073741824" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:41 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 Sep 09 17:02:41 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:41 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b49d421a-f43b-4511-a3de-60cc76889d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85190fb-98f6-4db4-bd39-32053e633290', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a439050-1312-4e22-a2c0-c4b59f664085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:41 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Volume volume-a85190fb-98f6-4db4-bd39-32053e633290 (a85190fb-98f6-4db4-bd39-32053e633290): created successfully Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a439050-1312-4e22-a2c0-c4b59f664085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Flow 'volume_create_manager' (a63e0aad-5689-482b-8f3d-9aaef934d596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fe6e659f-ca16-4658-91ad-5ca57be3572d tempest-VolumeDependencyTests-1836606958 None] Created volume successfully. Sep 09 17:02:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Creating offline snapshot 0680dc4d-ad11-40da-a831-a96a794873c0 of volume a85190fb-98f6-4db4-bd39-32053e633290 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:02:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca58d997-0d7c-4106-9dee-007df0b3a178]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:42 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 Sep 09 17:02:42 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:42 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:42 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 1G Sep 09 17:02:42 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:43 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 1G" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85190fb-98f6-4db4-bd39-32053e633290 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:43 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85190fb-98f6-4db4-bd39-32053e633290 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 Sep 09 17:02:43 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:43 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85190fb-98f6-4db4-bd39-32053e633290 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0" returned: 0 in 0.296s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:43 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 is being set with open permissions: ugo+rw Sep 09 17:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:43 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 Sep 09 17:02:43 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:43 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:43 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.info Sep 09 17:02:43 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:43 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.info" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:43 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.info is being set with open permissions: ugo+rw Sep 09 17:02:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:43 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.info Sep 09 17:02:43 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:44 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.info" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e571e29b-e9be-4769-8134-6d23e08d07f3 tempest-VolumeDependencyTests-1836606958 None] Create snapshot completed successfully Sep 09 17:02:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-93c69711-06b8-48c7-94a0-264c883bebaa req-480e17f4-0870-4f22-a6c5-1b4d14cd1e3a tempest-TestStampPattern-718821306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-93c69711-06b8-48c7-94a0-264c883bebaa req-480e17f4-0870-4f22-a6c5-1b4d14cd1e3a tempest-TestStampPattern-718821306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [req-93c69711-06b8-48c7-94a0-264c883bebaa req-480e17f4-0870-4f22-a6c5-1b4d14cd1e3a tempest-TestStampPattern-718821306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-93c69711-06b8-48c7-94a0-264c883bebaa req-480e17f4-0870-4f22-a6c5-1b4d14cd1e3a tempest-TestStampPattern-718821306 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e', 'name': 'volume-f0d131d8-8af2-4c71-9f3c-32c00c532771', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec0f3644-9457-4dec-9a15-5d386965aeee', 'enforce_multipath': True} {{(pid=87498) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 09 17:02:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-93c69711-06b8-48c7-94a0-264c883bebaa req-480e17f4-0870-4f22-a6c5-1b4d14cd1e3a tempest-TestStampPattern-718821306 None] attachment_update completed successfully. Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Flow 'volume_create_manager' (0ebe0dbb-18b1-4d65-8f47-7bd4f0b8a0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff51fe5-857b-48c9-b78f-a1c05adc651e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:45 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:45 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff51fe5-857b-48c9-b78f-a1c05adc651e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1430602767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7338124b-1f46-4d04-a407-cb1afd29de1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4427398a3c9740bf8b2af99f6ca5de47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0680dc4d-ad11-40da-a831-a96a794873c0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:02:45Z,use_quota=True,user_id='5072611351954e3997c2730721ef5ae2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356985e4-c1e9-4a9a-bf0f-494108d180fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (356985e4-c1e9-4a9a-bf0f-494108d180fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6660a0ab-392b-40f8-a68a-84223bd537c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6660a0ab-392b-40f8-a68a-84223bd537c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7338124b-1f46-4d04-a407-cb1afd29de1d', 'volume_name': 'volume-7338124b-1f46-4d04-a407-cb1afd29de1d', 'volume_size': 1, 'snapshot_id': '0680dc4d-ad11-40da-a831-a96a794873c0'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeae80b9-29a1-4ac3-8a07-b3b410e88918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeae80b9-29a1-4ac3-8a07-b3b410e88918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3a4b10-6686-4466-8c66-073806a1225d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Volume 7338124b-1f46-4d04-a407-cb1afd29de1d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7338124b-1f46-4d04-a407-cb1afd29de1d', 'volume_size': 1, 'snapshot_id': '0680dc4d-ad11-40da-a831-a96a794873c0'} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "cinder-quobyte-0680dc4d-ad11-40da-a831-a96a794873c0-7338124b-1f46-4d04-a407-cb1afd29de1d" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-0680dc4d-ad11-40da-a831-a96a794873c0-7338124b-1f46-4d04-a407-cb1afd29de1d" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Creating volume 7338124b-1f46-4d04-a407-cb1afd29de1d from snapshot 0680dc4d-ad11-40da-a831-a96a794873c0 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "cinder-quobyte-7338124b-1f46-4d04-a407-cb1afd29de1d" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-7338124b-1f46-4d04-a407-cb1afd29de1d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] snapshot: 0680dc4d-ad11-40da-a831-a96a794873c0, volume: 7338124b-1f46-4d04-a407-cb1afd29de1d, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cb924c-a488-4c15-bed7-e9d303d37db7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:45 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:02:45 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 Sep 09 17:02:45 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:45 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a85190fb-98f6-4db4-bd39-32053e633290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[108b373c-198b-4bf3-8867-5ef68eb2a380]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:45 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 Sep 09 17:02:45 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:46 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:02:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:02:46 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:02:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:46 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d Sep 09 17:02:46 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:49 devstack cinder-volume[87498]: INFO cinder.volume.manager [req-0ed70159-4c9e-4b7f-9bd4-9186e7c062a9 req-fdfea775-191f-4a65-9d23-e0c6a32f27b8 tempest-TestStampPattern-718821306 None] Terminate volume connection completed successfully. Sep 09 17:02:49 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [req-0ed70159-4c9e-4b7f-9bd4-9186e7c062a9 req-fdfea775-191f-4a65-9d23-e0c6a32f27b8 tempest-TestStampPattern-718821306 None] Deleting attachment ec0f3644-9457-4dec-9a15-5d386965aeee. {{(pid=87498) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 09 17:02:50 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d" returned: 0 in 4.693s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:50 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:02:50 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Converted 1024.00 MB image at 218.17 MB/s Sep 09 17:02:50 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d is being set with open permissions: ugo+rw Sep 09 17:02:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:50 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d Sep 09 17:02:50 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:51 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-7338124b-1f46-4d04-a407-cb1afd29de1d" released by "_copy_volume_from_snapshot" :: held 5.833s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-0680dc4d-ad11-40da-a831-a96a794873c0-7338124b-1f46-4d04-a407-cb1afd29de1d" released by "_create_volume_from_snapshot" :: held 5.915s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.934s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac3a4b10-6686-4466-8c66-073806a1225d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7338124b-1f46-4d04-a407-cb1afd29de1d', 'volume_size': 1, 'snapshot_id': '0680dc4d-ad11-40da-a831-a96a794873c0'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff1634d-32f1-459b-8d17-57cc9e88ad66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:02:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Volume volume-7338124b-1f46-4d04-a407-cb1afd29de1d (7338124b-1f46-4d04-a407-cb1afd29de1d): created successfully Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bff1634d-32f1-459b-8d17-57cc9e88ad66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Flow 'volume_create_manager' (0ebe0dbb-18b1-4d65-8f47-7bd4f0b8a0b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:02:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-554a6815-9dd9-4060-b0a7-bdfcedfd3204 tempest-VolumeDependencyTests-1836606958 None] Created volume successfully. Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "cinder-0680dc4d-ad11-40da-a831-a96a794873c0-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-0680dc4d-ad11-40da-a831-a96a794873c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "cinder-quobyte-a85190fb-98f6-4db4-bd39-32053e633290" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-a85190fb-98f6-4db4-bd39-32053e633290" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "cinder-quobyte-0680dc4d-ad11-40da-a831-a96a794873c0" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-0680dc4d-ad11-40da-a831-a96a794873c0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Deleting offline snapshot 0680dc4d-ad11-40da-a831-a96a794873c0 of volume a85190fb-98f6-4db4-bd39-32053e633290 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] snapshot_file for this snap is: volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0778a7-15a0-49bd-b747-8d7c7aac50d9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:52 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 Sep 09 17:02:52 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:52 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0" returned: 0 in 0.469s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a85190fb-98f6-4db4-bd39-32053e633290(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:02:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f0e821-23a5-43e0-899d-4f1dc34d4845]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:52 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 Sep 09 17:02:52 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:52 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290" returned: 0 in 0.614s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:53 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 Sep 09 17:02:53 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:53 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:53 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0 Sep 09 17:02:53 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:53 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290.0680dc4d-ad11-40da-a831-a96a794873c0" returned: 0 in 0.266s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-0680dc4d-ad11-40da-a831-a96a794873c0" released by "_delete_snapshot" :: held 1.891s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-a85190fb-98f6-4db4-bd39-32053e633290" released by "delete_snapshot" :: held 1.925s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Created reservations ['5f9dcece-10db-41be-a58e-02590dfda453', '381c3c25-993c-4883-8a98-f523e4adcd71', '58245c92-f7bd-4b34-b3d7-8deb5b0992b4', '8d6c9178-2642-4026-bf51-0f2e359d8968'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Delete snapshot completed successfully. Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e1cbcd8d-c090-413e-a91b-78690ed4fa2c tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-0680dc4d-ad11-40da-a831-a96a794873c0-delete_snapshot" released by "delete_snapshot" :: held 2.073s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "cinder-a85190fb-98f6-4db4-bd39-32053e633290-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-a85190fb-98f6-4db4-bd39-32053e633290-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "cinder-quobyte-a85190fb-98f6-4db4-bd39-32053e633290" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-a85190fb-98f6-4db4-bd39-32053e633290" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d83092-0bb9-43cc-8f1b-34dc88d97048]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:54 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 Sep 09 17:02:54 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Acquiring lock "cinder-f0d131d8-8af2-4c71-9f3c-32c00c532771-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Lock "cinder-f0d131d8-8af2-4c71-9f3c-32c00c532771-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Acquiring lock "cinder-quobyte-f0d131d8-8af2-4c71-9f3c-32c00c532771" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-f0d131d8-8af2-4c71-9f3c-32c00c532771" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[45005732-13a4-4252-b97f-c96f2dc3fa11]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:54 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 Sep 09 17:02:54 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:54 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:54 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290 Sep 09 17:02:54 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:54 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:54 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a85190fb-98f6-4db4-bd39-32053e633290" returned: 0 in 0.272s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:54 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771 Sep 09 17:02:54 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-a85190fb-98f6-4db4-bd39-32053e633290" released by "delete_volume" :: held 0.742s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Created reservations ['8d949ab9-ccf6-4ea3-b7ba-f84271d59208', '60fb2506-af48-43bb-b849-8f8aaaf665af', 'ad3b8722-c882-42af-8aac-7ba6ab37be61', 'a9cbbf3e-4444-4d67-a6b7-3cc126edd98f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:54 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:54 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:54 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f0d131d8-8af2-4c71-9f3c-32c00c532771" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-f0d131d8-8af2-4c71-9f3c-32c00c532771" released by "delete_volume" :: held 0.740s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Created reservations ['e2919dad-fa31-42b4-80dc-0a3cec20b20b', 'a9dcc73c-2627-4e65-9194-92f6e23f991c', '742cd145-145d-4a79-bfe5-4490c8915177', '31a60224-4de2-4436-b471-44f52a94a9a2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:55 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "cinder-7338124b-1f46-4d04-a407-cb1afd29de1d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:55 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:55 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Deleted volume successfully. Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-7338124b-1f46-4d04-a407-cb1afd29de1d-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9fdc581b-5f42-4101-9f5a-98dd8e2861ae tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-a85190fb-98f6-4db4-bd39-32053e633290-delete_volume" released by "delete_volume" :: held 1.266s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "cinder-quobyte-7338124b-1f46-4d04-a407-cb1afd29de1d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-7338124b-1f46-4d04-a407-cb1afd29de1d" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[74784855-26a0-4d41-9f67-b1388206f836]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:55 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d Sep 09 17:02:55 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:55 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.298s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Deleted volume successfully. Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-195d3760-e6d7-4729-aaa3-1aab99ae0da5 tempest-TestStampPattern-718821306 None] Lock "cinder-f0d131d8-8af2-4c71-9f3c-32c00c532771-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Acquiring lock "cinder-f2af771a-0a09-4e16-9399-6d0f947304ab-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Lock "cinder-f2af771a-0a09-4e16-9399-6d0f947304ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Acquiring lock "cinder-quobyte-fce8085c-abe7-42e0-a460-012fbb6fe50c" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-fce8085c-abe7-42e0-a460-012fbb6fe50c" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Acquiring lock "cinder-quobyte-f2af771a-0a09-4e16-9399-6d0f947304ab" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-f2af771a-0a09-4e16-9399-6d0f947304ab" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Deleting offline snapshot f2af771a-0a09-4e16-9399-6d0f947304ab of volume fce8085c-abe7-42e0-a460-012fbb6fe50c {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] snapshot_file for this snap is: volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[00079af7-38bf-4352-8397-55d57dffec44]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:55 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:55 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d Sep 09 17:02:55 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:55 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab Sep 09 17:02:55 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:55 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7338124b-1f46-4d04-a407-cb1afd29de1d" returned: 0 in 0.262s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-quobyte-7338124b-1f46-4d04-a407-cb1afd29de1d" released by "delete_volume" :: held 0.774s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Created reservations ['9e46d2f9-6a65-4080-89ab-9b7c8665b12a', '04951b86-76cc-4585-8086-ff8290b3dc27', 'fd103927-6ccf-49b5-b9c4-de8dfeeb2a5c', '375877cf-6f7c-45e3-8443-ec0e4becdc34'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:56 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fce8085c-abe7-42e0-a460-012fbb6fe50c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a0a499-fd8f-4ca6-a1c9-3ee76e2bb129]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:56 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:02:56 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:56 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c Sep 09 17:02:56 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:56 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:02:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Deleted volume successfully. Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5bae2fd3-6761-498e-a03d-b55e3403449d tempest-VolumeDependencyTests-1836606958 None] Lock "cinder-7338124b-1f46-4d04-a407-cb1afd29de1d-delete_volume" released by "delete_volume" :: held 1.308s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:56 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c" returned: 0 in 0.609s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:56 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab Sep 09 17:02:56 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:57 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab" returned: 0 in 0.400s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:02:57 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab Sep 09 17:02:57 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:02:57 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 09 17:02:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c.f2af771a-0a09-4e16-9399-6d0f947304ab" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:02:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-f2af771a-0a09-4e16-9399-6d0f947304ab" released by "_delete_snapshot" :: held 1.756s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-fce8085c-abe7-42e0-a460-012fbb6fe50c" released by "delete_snapshot" :: held 1.780s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:02:57 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Created reservations ['1bfb320c-5275-4801-a59e-204706ab0d73', '1afbd03d-ed78-497b-b9c4-beffa852103c', '6d544eb1-cbb5-4029-9207-fb1aa3219732', '4df301f3-3072-4a4a-9462-85828ca00fd6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:02:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Delete snapshot completed successfully. Sep 09 17:02:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-dbc6a0a3-415e-45b8-a899-06204936075d tempest-TestStampPattern-718821306 None] Lock "cinder-f2af771a-0a09-4e16-9399-6d0f947304ab-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Acquiring lock "cinder-fce8085c-abe7-42e0-a460-012fbb6fe50c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Lock "cinder-fce8085c-abe7-42e0-a460-012fbb6fe50c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Acquiring lock "cinder-quobyte-fce8085c-abe7-42e0-a460-012fbb6fe50c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-fce8085c-abe7-42e0-a460-012fbb6fe50c" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e5c53a-82bf-4d15-be17-7d2e1ff2b388]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:01 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c Sep 09 17:03:01 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:01 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:01 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c Sep 09 17:03:01 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:02 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-fce8085c-abe7-42e0-a460-012fbb6fe50c" returned: 0 in 0.267s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Lock "cinder-quobyte-fce8085c-abe7-42e0-a460-012fbb6fe50c" released by "delete_volume" :: held 0.721s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Created reservations ['6151ca55-13f4-48a9-866b-2f838edc73de', '0150d7b9-ded8-4739-91be-4aa044ab214e', '592b3f59-cf6c-4703-9eec-f6e2ef6074c3', 'c89d9941-7cd4-4cfa-a73b-17e94699add7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:02 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:02 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:02 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Deleted volume successfully. Sep 09 17:03:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f2ecf0b-3115-4560-beba-a393f51e65e8 tempest-TestStampPattern-718821306 None] Lock "cinder-fce8085c-abe7-42e0-a460-012fbb6fe50c-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:12 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=110,cinder:SELECT=83,cinder:DELETE=6,cinder:INSERT=25 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:03:12 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=82,cinder:UPDATE=104,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (50d5340d-4a8a-4140-b33e-3b9d7e4c0a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81392fbd-4c4d-47e5-bc51-796570435198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81392fbd-4c4d-47e5-bc51-796570435198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548917454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6fd511e-19dc-4733-ac8f-3a5fd4d0123a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:14Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36499cf0-ab21-42ea-8fb9-287dfc9d5208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36499cf0-ab21-42ea-8fb9-287dfc9d5208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275df918-6697-494b-93f7-d0288e16e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275df918-6697-494b-93f7-d0288e16e789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6fd511e-19dc-4733-ac8f-3a5fd4d0123a', 'volume_name': 'volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514f8cd0-03cb-4878-ab4a-ce1abfcfcc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514f8cd0-03cb-4878-ab4a-ce1abfcfcc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5411a5ac-87fd-42c0-ab05-a5acee624a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume d6fd511e-19dc-4733-ac8f-3a5fd4d0123a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a', 'volume_size': 1} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1548917454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6fd511e-19dc-4733-ac8f-3a5fd4d0123a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:14Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Creating volume d6fd511e-19dc-4733-ac8f-3a5fd4d0123a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:03:14 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:14 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a 1073741824 Sep 09 17:03:14 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:14 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a 1073741824" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:14 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a Sep 09 17:03:14 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:15 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5411a5ac-87fd-42c0-ab05-a5acee624a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6c5f40-418b-4f75-b0bd-ea8fc4f6869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a (d6fd511e-19dc-4733-ac8f-3a5fd4d0123a): created successfully Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6c5f40-418b-4f75-b0bd-ea8fc4f6869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (50d5340d-4a8a-4140-b33e-3b9d7e4c0a75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a9bd7d36-5d23-4b05-a2a4-293e2320aa2d tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created volume successfully. Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Creating offline snapshot 1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 of volume d6fd511e-19dc-4733-ac8f-3a5fd4d0123a {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a853dfb8-8dc1-420d-bfd3-33cb480c96b9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:15 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a Sep 09 17:03:15 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:15 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:15 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 1G Sep 09 17:03:15 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:16 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 1G" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:16 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 Sep 09 17:03:16 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:16 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360" returned: 0 in 0.291s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:16 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 is being set with open permissions: ugo+rw Sep 09 17:03:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:16 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 Sep 09 17:03:16 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:16 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360" returned: 0 in 0.229s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:16 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.info Sep 09 17:03:16 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:17 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.info" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:17 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.info is being set with open permissions: ugo+rw Sep 09 17:03:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:17 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.info Sep 09 17:03:17 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:17 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.info" returned: 0 in 0.224s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.799s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6a187459-d0e6-4d7a-93c1-4d1e6fdda8ea tempest-CreateVolumesFromSnapshotTest-1170150446 None] Create snapshot completed successfully Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (3db0c692-e2e2-4a84-bb0d-0a77086ca3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3acc75a-83f6-4365-bf55-8d3e36388e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3acc75a-83f6-4365-bf55-8d3e36388e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-177375903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ea3d83-c35e-4c30-a9f7-eb870a5f4624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:18Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657e3cc2-47dc-46e9-bf94-3e7946d8c84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (657e3cc2-47dc-46e9-bf94-3e7946d8c84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba64577-ca07-4068-a8fc-e13fb4862541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba64577-ca07-4068-a8fc-e13fb4862541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ea3d83-c35e-4c30-a9f7-eb870a5f4624', 'volume_name': 'volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdeadec7-3b1a-4641-af1e-1570378cdf8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdeadec7-3b1a-4641-af1e-1570378cdf8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c813f567-3a9f-497a-b433-592b64379b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume 28ea3d83-c35e-4c30-a9f7-eb870a5f4624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624', 'volume_size': 1} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-177375903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ea3d83-c35e-4c30-a9f7-eb870a5f4624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:18Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Creating volume 28ea3d83-c35e-4c30-a9f7-eb870a5f4624 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:03:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:18 devstack sudo[106772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624 1073741824 Sep 09 17:03:18 devstack sudo[106772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (416f82bf-984b-46d0-86ad-77c414291ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97570eda-390d-4bc4-83b9-cf6647fe2d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97570eda-390d-4bc4-83b9-cf6647fe2d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-211861701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352c0e11-e1fc-480d-a8ca-46c304200d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:18Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e2be01-951e-4160-b921-d4077ce925d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e2be01-951e-4160-b921-d4077ce925d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f602fc-57e4-4aa2-ac3b-b253c0d47a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87f602fc-57e4-4aa2-ac3b-b253c0d47a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352c0e11-e1fc-480d-a8ca-46c304200d5b', 'volume_name': 'volume-352c0e11-e1fc-480d-a8ca-46c304200d5b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76946f3-6b40-4aae-8f22-5efe07e5a8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a76946f3-6b40-4aae-8f22-5efe07e5a8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f71103-b253-4904-943d-344be31a8831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume 352c0e11-e1fc-480d-a8ca-46c304200d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352c0e11-e1fc-480d-a8ca-46c304200d5b', 'volume_size': 1} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:18 devstack sudo[106772]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624 1073741824" returned: 0 in 0.508s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:18 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624 Sep 09 17:03:18 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (9c651b9d-f0f9-4fee-b852-1fe7fc2e9133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0c6bca-1b5e-4de6-84e5-bf1b260f7560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0c6bca-1b5e-4de6-84e5-bf1b260f7560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705028328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5067f713-b1f5-4df1-a15f-82ed9ed62861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:19Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69ad066-951f-4deb-8316-66ce5bf07452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69ad066-951f-4deb-8316-66ce5bf07452) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe9f264-7543-4f97-8aba-677f3724a105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe9f264-7543-4f97-8aba-677f3724a105) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5067f713-b1f5-4df1-a15f-82ed9ed62861', 'volume_name': 'volume-5067f713-b1f5-4df1-a15f-82ed9ed62861', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5200ed6b-2482-43bc-bf38-ff978c1a4a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5200ed6b-2482-43bc-bf38-ff978c1a4a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1a2277-05ce-4abf-9296-f80a5974ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume 5067f713-b1f5-4df1-a15f-82ed9ed62861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5067f713-b1f5-4df1-a15f-82ed9ed62861', 'volume_size': 1} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:18 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.476s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-211861701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352c0e11-e1fc-480d-a8ca-46c304200d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:18Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Creating volume 352c0e11-e1fc-480d-a8ca-46c304200d5b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:03:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:03:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c813f567-3a9f-497a-b433-592b64379b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b 1073741824 Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba510b1-9d24-4f9c-a217-398cb059b74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624 (28ea3d83-c35e-4c30-a9f7-eb870a5f4624): created successfully Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba510b1-9d24-4f9c-a217-398cb059b74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (3db0c692-e2e2-4a84-bb0d-0a77086ca3ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a053312b-ccb0-43aa-9a5d-f33ee5a89e15 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created volume successfully. Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (01b4bf2c-cf92-4a52-b4dc-ee02b1045de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565e6e66-b198-4d63-9da6-dbec80cf6ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (565e6e66-b198-4d63-9da6-dbec80cf6ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1454831587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059638ba-e59e-46a5-9454-abffefe57faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:19Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de75e285-4a27-4ee6-ac89-8cba54149335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de75e285-4a27-4ee6-ac89-8cba54149335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb7418b-917f-4a41-be66-e7e8bc33b16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb7418b-917f-4a41-be66-e7e8bc33b16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '059638ba-e59e-46a5-9454-abffefe57faf', 'volume_name': 'volume-059638ba-e59e-46a5-9454-abffefe57faf', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a873ab-dbd9-4a02-9f96-259aa8de1ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09a873ab-dbd9-4a02-9f96-259aa8de1ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54241fea-6ef0-4c9c-a166-df4501400a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume 059638ba-e59e-46a5-9454-abffefe57faf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-059638ba-e59e-46a5-9454-abffefe57faf', 'volume_size': 1} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:03:19 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (b714f2b8-11c5-475b-a164-2dd1eb252298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7efc315-012b-4842-9b4d-cada66f2e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b 1073741824" returned: 0 in 0.519s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7efc315-012b-4842-9b4d-cada66f2e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1257210720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a16301-264b-4659-a5d8-2ed663b43b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:19Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432172ad-1644-465a-aaa0-602b40c6685c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432172ad-1644-465a-aaa0-602b40c6685c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c68dd34-4c27-44b3-8eef-5bbfb33c38c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c68dd34-4c27-44b3-8eef-5bbfb33c38c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a16301-264b-4659-a5d8-2ed663b43b7d', 'volume_name': 'volume-a1a16301-264b-4659-a5d8-2ed663b43b7d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea5eb80-8dfa-4655-a842-28080960bf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ea5eb80-8dfa-4655-a842-28080960bf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a13853d-8358-4e6a-8bc3-f39b8d3d416e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume a1a16301-264b-4659-a5d8-2ed663b43b7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a16301-264b-4659-a5d8-2ed663b43b7d', 'volume_size': 1} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:19 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b Sep 09 17:03:19 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:19 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.951s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-705028328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5067f713-b1f5-4df1-a15f-82ed9ed62861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:19Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Creating volume 5067f713-b1f5-4df1-a15f-82ed9ed62861 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:03:19 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f71103-b253-4904-943d-344be31a8831) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352c0e11-e1fc-480d-a8ca-46c304200d5b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861 1073741824 Sep 09 17:03:19 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94269a68-4fca-4e5e-9a3a-7fcc6d812cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume volume-352c0e11-e1fc-480d-a8ca-46c304200d5b (352c0e11-e1fc-480d-a8ca-46c304200d5b): created successfully Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94269a68-4fca-4e5e-9a3a-7fcc6d812cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (416f82bf-984b-46d0-86ad-77c414291ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-77518a9b-5062-4b14-8211-9c08fb1354ba tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created volume successfully. Sep 09 17:03:20 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861 1073741824" returned: 0 in 0.391s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:20 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861 Sep 09 17:03:20 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:20 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.276s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1454831587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=059638ba-e59e-46a5-9454-abffefe57faf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:19Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Creating volume 059638ba-e59e-46a5-9454-abffefe57faf {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:03:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:20 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf 1073741824 Sep 09 17:03:20 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd1a2277-05ce-4abf-9296-f80a5974ca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5067f713-b1f5-4df1-a15f-82ed9ed62861', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0624c1c-c1d6-466a-bea6-965aaa075e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume volume-5067f713-b1f5-4df1-a15f-82ed9ed62861 (5067f713-b1f5-4df1-a15f-82ed9ed62861): created successfully Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0624c1c-c1d6-466a-bea6-965aaa075e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (9c651b9d-f0f9-4fee-b852-1fe7fc2e9133) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-899f2146-470d-49d4-a938-00e8e6092eb9 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created volume successfully. Sep 09 17:03:20 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf 1073741824" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:20 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf Sep 09 17:03:20 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:21 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf" returned: 0 in 0.228s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1257210720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a16301-264b-4659-a5d8-2ed663b43b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e096e293907460ebc713d7968978029',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:19Z,use_quota=True,user_id='922f86edcd0b429b890c57eb64f44274',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Creating volume a1a16301-264b-4659-a5d8-2ed663b43b7d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:03:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54241fea-6ef0-4c9c-a166-df4501400a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-059638ba-e59e-46a5-9454-abffefe57faf', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:21 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d 1073741824 Sep 09 17:03:21 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be448d98-bd1b-480c-b2af-9184574d9437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume volume-059638ba-e59e-46a5-9454-abffefe57faf (059638ba-e59e-46a5-9454-abffefe57faf): created successfully Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be448d98-bd1b-480c-b2af-9184574d9437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (01b4bf2c-cf92-4a52-b4dc-ee02b1045de8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5787a314-c560-4df2-a55f-baf63e32c874 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created volume successfully. Sep 09 17:03:21 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d 1073741824" returned: 0 in 0.410s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:21 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d Sep 09 17:03:21 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:21 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a13853d-8358-4e6a-8bc3-f39b8d3d416e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a16301-264b-4659-a5d8-2ed663b43b7d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7af3b0-a424-4107-88a5-a661162911b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Volume volume-a1a16301-264b-4659-a5d8-2ed663b43b7d (a1a16301-264b-4659-a5d8-2ed663b43b7d): created successfully Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e7af3b0-a424-4107-88a5-a661162911b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Flow 'volume_create_manager' (b714f2b8-11c5-475b-a164-2dd1eb252298) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-73e4e419-bafd-45bd-acfb-3b2316216fdf tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created volume successfully. Sep 09 17:03:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-a1a16301-264b-4659-a5d8-2ed663b43b7d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-a1a16301-264b-4659-a5d8-2ed663b43b7d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-quobyte-a1a16301-264b-4659-a5d8-2ed663b43b7d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-a1a16301-264b-4659-a5d8-2ed663b43b7d" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[194e3361-2f1f-4ab7-b7eb-161ad7da2b2f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:23 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d Sep 09 17:03:23 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:23 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:23 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d Sep 09 17:03:23 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:23 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a1a16301-264b-4659-a5d8-2ed663b43b7d" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-a1a16301-264b-4659-a5d8-2ed663b43b7d" released by "delete_volume" :: held 0.643s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created reservations ['a349af8a-bd1a-4e27-921a-5cb0d17beef4', 'e1fcdbc2-f419-4cfd-afa0-f213e9fa265d', '3e422076-2082-469e-96e3-2046ea53f54c', '30e4a587-d579-49bb-9779-c6dd68fe3af3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:23 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:23 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:23 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Deleted volume successfully. Sep 09 17:03:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-42fa3e5f-1c0c-41df-bd80-fa775b07cf63 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-a1a16301-264b-4659-a5d8-2ed663b43b7d-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-059638ba-e59e-46a5-9454-abffefe57faf-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-059638ba-e59e-46a5-9454-abffefe57faf-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-quobyte-059638ba-e59e-46a5-9454-abffefe57faf" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-059638ba-e59e-46a5-9454-abffefe57faf" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[de740375-3aa1-42e7-8f4c-16bc6c951eee]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:24 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf Sep 09 17:03:24 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:24 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:24 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf Sep 09 17:03:24 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:24 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-059638ba-e59e-46a5-9454-abffefe57faf" returned: 0 in 0.231s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-059638ba-e59e-46a5-9454-abffefe57faf" released by "delete_volume" :: held 0.612s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created reservations ['51807802-e7d5-4b66-a569-b91f7971ae1e', '6bb6ab61-6f1b-47fc-b4e4-f969273b0a78', 'f2d40ade-4327-43e6-b67f-e668090d9403', '8871f041-ba66-4d1e-9e00-2230ac802346'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:24 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:24 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:25 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Deleted volume successfully. Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-aedf6cd8-441e-4478-82fc-74c8b1c86903 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-059638ba-e59e-46a5-9454-abffefe57faf-delete_volume" released by "delete_volume" :: held 1.020s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-5067f713-b1f5-4df1-a15f-82ed9ed62861-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-5067f713-b1f5-4df1-a15f-82ed9ed62861-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-quobyte-5067f713-b1f5-4df1-a15f-82ed9ed62861" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-5067f713-b1f5-4df1-a15f-82ed9ed62861" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9430569f-c21c-4810-bd7d-0cc3543f4e96]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:25 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861 Sep 09 17:03:25 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:25 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:25 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861 Sep 09 17:03:25 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:25 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-5067f713-b1f5-4df1-a15f-82ed9ed62861" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-5067f713-b1f5-4df1-a15f-82ed9ed62861" released by "delete_volume" :: held 0.631s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created reservations ['74893a0f-b055-4afd-bf3d-dfc90bfadb4f', '8c149af6-87cf-4e70-aae0-e324caa50078', '1fafb145-af8e-44bd-92d6-0bf681c8d8f2', '25572422-7e07-4aa2-9c41-f8ec191747e6'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:25 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:25 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:26 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Deleted volume successfully. Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36015252-e94e-42c7-8fdb-d9fafb6b51d7 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-5067f713-b1f5-4df1-a15f-82ed9ed62861-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-352c0e11-e1fc-480d-a8ca-46c304200d5b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-352c0e11-e1fc-480d-a8ca-46c304200d5b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-quobyte-352c0e11-e1fc-480d-a8ca-46c304200d5b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-352c0e11-e1fc-480d-a8ca-46c304200d5b" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[449a0b8d-a4f0-4d7b-a68d-ec0d65ab94cf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:26 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b Sep 09 17:03:26 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:26 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:26 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b Sep 09 17:03:26 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:26 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-352c0e11-e1fc-480d-a8ca-46c304200d5b" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-352c0e11-e1fc-480d-a8ca-46c304200d5b" released by "delete_volume" :: held 0.625s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created reservations ['d1c49a72-c876-4161-a96d-df487a790341', 'fdd3b00d-6b9d-4d43-bb95-0719f482f712', 'bc4742a4-d8f9-4df2-840c-bba9fcb77d2c', '570a2e3f-1b92-46a9-a719-965c72bfb2d4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:27 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:27 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:27 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:27 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Deleted volume successfully. Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0e6a3a4f-e274-46fc-9bb3-8da708767d25 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-352c0e11-e1fc-480d-a8ca-46c304200d5b-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-28ea3d83-c35e-4c30-a9f7-eb870a5f4624-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-28ea3d83-c35e-4c30-a9f7-eb870a5f4624-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-quobyte-28ea3d83-c35e-4c30-a9f7-eb870a5f4624" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-28ea3d83-c35e-4c30-a9f7-eb870a5f4624" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f270fd13-362e-4ad4-86b2-4b271fbb8986]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:27 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624 Sep 09 17:03:27 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:27 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:27 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624 Sep 09 17:03:27 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:28 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-28ea3d83-c35e-4c30-a9f7-eb870a5f4624" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-28ea3d83-c35e-4c30-a9f7-eb870a5f4624" released by "delete_volume" :: held 0.625s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created reservations ['9aafadfc-3036-4010-973b-6bbdcf1dffa8', 'b85d2c4f-fc37-4b5c-aba3-aba76a7b54ca', '1638a82c-c574-462e-b993-32cb7b4f6bc2', '1a990da7-58c1-4a25-b368-82f13b802928'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:28 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:28 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:28 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Deleted volume successfully. Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a9476b8-d3ab-4895-be34-31bbe707fe4a tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-28ea3d83-c35e-4c30-a9f7-eb870a5f4624-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-quobyte-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-quobyte-1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Deleting offline snapshot 1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 of volume d6fd511e-19dc-4733-ac8f-3a5fd4d0123a {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] snapshot_file for this snap is: volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc445e6a-bab6-4681-ac32-3ff01a70140f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:28 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 Sep 09 17:03:28 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:29 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:03:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb38cc8-e2a5-419f-af8a-a77e0b15a639]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:29 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a Sep 09 17:03:29 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:29 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:29 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 Sep 09 17:03:29 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:29 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:29 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360 Sep 09 17:03:29 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:30 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a.1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360" released by "_delete_snapshot" :: held 1.410s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" released by "delete_snapshot" :: held 1.431s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created reservations ['62b4af9c-7603-4e6c-9f96-0540c9f8f082', '03ed6296-ed6e-4d2b-9a9b-580a415f8f0e', 'a8929f0c-96e5-4bbf-a0c9-497570ab03d9', 'f2077c2e-73c9-45eb-abf9-a50bf9b987cb'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Delete snapshot completed successfully. Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b5915ae6-5907-4b0c-96ae-f1288da6665e tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-1fd9de2e-8a35-4bb6-ba5c-a8ed9d639360-delete_snapshot" released by "delete_snapshot" :: held 1.567s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "cinder-quobyte-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1d2138-4bbb-4201-9773-5d6624dc71dd]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:30 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a Sep 09 17:03:30 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:31 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:31 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a Sep 09 17:03:31 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:31 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-quobyte-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a" released by "delete_volume" :: held 0.653s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Created reservations ['d29db436-83ad-43f0-b62b-002db5e4900c', '5c226f7a-85fb-4739-8623-7c9edd59bd31', '14bf8d0c-5ad6-4201-bb1b-20dc8e9d1aaa', '32c79c42-7d7b-4935-b5e9-a3fa1db5fffc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:31 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:31 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:31 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.248s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Deleted volume successfully. Sep 09 17:03:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-87276766-1976-46e5-a153-7511c7e8ecf3 tempest-CreateVolumesFromSnapshotTest-1170150446 None] Lock "cinder-d6fd511e-19dc-4733-ac8f-3a5fd4d0123a-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Flow 'volume_create_manager' (d8c046f6-7529-4dfc-8c05-b557c3fcf6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70da0a25-28eb-444e-8859-d686609f5ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70da0a25-28eb-444e-8859-d686609f5ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4894311ba89a4b4c86d7ab68a177b4b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:36Z,use_quota=True,user_id='e866ec93e8f84ca9a8020d9924e05d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9215d4b-7e25-47f2-8e49-73b0461a288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9215d4b-7e25-47f2-8e49-73b0461a288c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78aef7b-fd52-41bf-bee2-33af2a8a8c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78aef7b-fd52-41bf-bee2-33af2a8a8c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a', 'volume_name': 'volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a', 'volume_size': 1, 'image_id': '4dfb1b50-986d-4f38-b80c-32af1dedd174', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfb1b50-986d-4f38-b80c-32af1dedd174', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7dde057650296ab5d89b015e151875e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4894311ba89a4b4c86d7ab68a177b4b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'beb411667d7703302aaf8c41f380378f0fe298b5b94748ca09de774bd8add5072d75d9d445c744771ebcf1f71d0cc75b3746c50e442dc7d66dbfcee58acd075e', 'id': '4dfb1b50-986d-4f38-b80c-32af1dedd174', 'created_at': datetime.datetime(2026, 9, 9, 15, 3, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfb1b50-986d-4f38-b80c-32af1dedd174/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86bf086a-2ee7-4251-a4c0-7313ab3e627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86bf086a-2ee7-4251-a4c0-7313ab3e627b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75101f9b-8474-469a-97e0-502acb142530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Volume 56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a', 'volume_size': 1, 'image_id': '4dfb1b50-986d-4f38-b80c-32af1dedd174', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfb1b50-986d-4f38-b80c-32af1dedd174', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7dde057650296ab5d89b015e151875e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4894311ba89a4b4c86d7ab68a177b4b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'beb411667d7703302aaf8c41f380378f0fe298b5b94748ca09de774bd8add5072d75d9d445c744771ebcf1f71d0cc75b3746c50e442dc7d66dbfcee58acd075e', 'id': '4dfb1b50-986d-4f38-b80c-32af1dedd174', 'created_at': datetime.datetime(2026, 9, 9, 15, 3, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfb1b50-986d-4f38-b80c-32af1dedd174/file', 'properties': {}}, 'image_service': } Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Trying to clone 56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a from image 4dfb1b50-986d-4f38-b80c-32af1dedd174 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4dfb1b50-986d-4f38-b80c-32af1dedd174', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 17:03:36 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 17:03:36 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Image download 0.00 MB at 0.00 MB/s Sep 09 17:03:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[39107e09-4eff-4986-bdd9-343aa15ea254]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:37 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD Sep 09 17:03:37 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:37 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:37 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD Sep 09 17:03:37 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:37 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD" returned: 1 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:03:37 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Temporary image 4dfb1b50-986d-4f38-b80c-32af1dedd174 is fetched for user e866ec93e8f84ca9a8020d9924e05d1a. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 17:03:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ac358d-539c-4468-86a3-0270318383c6]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:37 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD Sep 09 17:03:37 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:38 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD" returned: 0 in 0.307s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:38 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD Sep 09 17:03:38 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:38 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD" returned: 1 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4894311ba89a4b4c86d7ab68a177b4b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:36Z,use_quota=True,user_id='e866ec93e8f84ca9a8020d9924e05d1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Creating volume 56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:03:38 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:38 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a 1073741824 Sep 09 17:03:38 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:38 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a 1073741824" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:38 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a Sep 09 17:03:38 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:39 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.660s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Attempting download of 4dfb1b50-986d-4f38-b80c-32af1dedd174 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dfb1b50-986d-4f38-b80c-32af1dedd174', 'metadata': {}}])) to volume 56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1197}} Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b40026-e589-44e3-b982-4811d174645d]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfb1b50-986d-4f38-b80c-32af1dedd174_1kj0mob7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:39 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfb1b50-986d-4f38-b80c-32af1dedd174_1kj0mob7 Sep 09 17:03:39 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:39 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4dfb1b50-986d-4f38-b80c-32af1dedd174_1kj0mob7" returned: 0 in 0.309s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfb1b50-986d-4f38-b80c-32af1dedd174_1kj0mob7 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:39 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfb1b50-986d-4f38-b80c-32af1dedd174_1kj0mob7 Sep 09 17:03:39 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:39 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfb1b50-986d-4f38-b80c-32af1dedd174_1kj0mob7" returned: 1 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4dfb1b50-986d-4f38-b80c-32af1dedd174_1kj0mob7' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[caec89dc-f049-4fd3-b598-63ca9c6070e9]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:39 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD Sep 09 17:03:39 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:40 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:40 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD Sep 09 17:03:40 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:40 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD" returned: 1 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:03:40 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] 4dfb1b50-986d-4f38-b80c-32af1dedd174 was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 17:03:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:40 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a Sep 09 17:03:40 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:40 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a" returned: 0 in 0.409s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:40 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4dfb1b50-986d-4f38-b80c-32af1dedd174_rcwdwht1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:03:40 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 17:03:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:40 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a 1G Sep 09 17:03:40 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:41 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a 1G" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Downloaded image 4dfb1b50-986d-4f38-b80c-32af1dedd174 ((None, [{'url': 'file:///opt/stack/data/glance/images/4dfb1b50-986d-4f38-b80c-32af1dedd174', 'metadata': {}}])) to volume 56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1242}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Temporary image 4dfb1b50-986d-4f38-b80c-32af1dedd174 for user e866ec93e8f84ca9a8020d9924e05d1a is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Marking volume 56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1146}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Copying metadata from image 4dfb1b50-986d-4f38-b80c-32af1dedd174 to 56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Creating volume glance metadata for volume 56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a backed by image 4dfb1b50-986d-4f38-b80c-32af1dedd174 with: {'image_id': '4dfb1b50-986d-4f38-b80c-32af1dedd174', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7dde057650296ab5d89b015e151875e5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75101f9b-8474-469a-97e0-502acb142530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a', 'volume_size': 1, 'image_id': '4dfb1b50-986d-4f38-b80c-32af1dedd174', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4dfb1b50-986d-4f38-b80c-32af1dedd174', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7dde057650296ab5d89b015e151875e5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4894311ba89a4b4c86d7ab68a177b4b2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'beb411667d7703302aaf8c41f380378f0fe298b5b94748ca09de774bd8add5072d75d9d445c744771ebcf1f71d0cc75b3746c50e442dc7d66dbfcee58acd075e', 'id': '4dfb1b50-986d-4f38-b80c-32af1dedd174', 'created_at': datetime.datetime(2026, 9, 9, 15, 3, 35, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 3, 36, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4dfb1b50-986d-4f38-b80c-32af1dedd174/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0f828f-f92a-4619-84da-8a8294d7bedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:41 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Volume volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a (56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a): created successfully Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0f828f-f92a-4619-84da-8a8294d7bedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Flow 'volume_create_manager' (d8c046f6-7529-4dfc-8c05-b557c3fcf6b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-91152ef1-a5d2-4830-bb14-ce7203db3882 tempest-VolumeImageDependencyTests-1565776093 None] Created volume successfully. Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Acquiring lock "cinder-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Lock "cinder-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Acquiring lock "cinder-quobyte-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Lock "cinder-quobyte-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[722b47a9-7612-4729-8778-95f916b6143f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:41 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a Sep 09 17:03:41 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:42 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:42 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a Sep 09 17:03:42 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:42 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Lock "cinder-quobyte-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a" released by "delete_volume" :: held 0.611s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Created reservations ['24e599f4-35ed-4f31-b735-10f520360f35', '8cba682f-a8d0-4487-87ce-7c3e201b249a', 'b6d1c615-dbc4-4262-8882-b32aef239296', '9d675e28-b4f7-4958-9854-beb65d2504b4'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:42 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:42 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:42 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.225s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Deleted volume successfully. Sep 09 17:03:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-2f8d0b1c-1169-47bb-b5ce-61c3a3d85706 tempest-VolumeImageDependencyTests-1565776093 None] Lock "cinder-56ae8806-6f9b-4abf-a3b0-9ff0c82b9d8a-delete_volume" released by "delete_volume" :: held 1.026s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:45 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:45 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:45 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Flow 'volume_create_manager' (aa6072ed-b78b-4568-ac1c-8c7fcaf07e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa55ed1-4067-4364-b910-3e9ea88c8d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aa55ed1-4067-4364-b910-3e9ea88c8d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049fa76a-7a61-49f4-a653-610b3390321a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f24b356e3d343149d6fa2ff3419a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:46Z,use_quota=True,user_id='d99a65514c5b45ffa71cc4671eb90b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acf8622-aafb-4611-b7bc-7b42bae06b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4acf8622-aafb-4611-b7bc-7b42bae06b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae72cd3-c2a9-484e-aedd-63a57a5c6b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae72cd3-c2a9-484e-aedd-63a57a5c6b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '049fa76a-7a61-49f4-a653-610b3390321a', 'volume_name': 'volume-049fa76a-7a61-49f4-a653-610b3390321a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7b272c-30aa-4037-bcd2-511cdde28225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd7b272c-30aa-4037-bcd2-511cdde28225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09aaf545-18f6-4f91-a42b-b817506807fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Volume 049fa76a-7a61-49f4-a653-610b3390321a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-049fa76a-7a61-49f4-a653-610b3390321a', 'volume_size': 1} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049fa76a-7a61-49f4-a653-610b3390321a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f24b356e3d343149d6fa2ff3419a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:46Z,use_quota=True,user_id='d99a65514c5b45ffa71cc4671eb90b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Creating volume 049fa76a-7a61-49f4-a653-610b3390321a {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:03:45 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:03:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:45 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a 1073741824 Sep 09 17:03:45 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:46 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a 1073741824" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:46 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a Sep 09 17:03:46 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:46 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a" returned: 0 in 0.230s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] <== create_volume: return (650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:03:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09aaf545-18f6-4f91-a42b-b817506807fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049fa76a-7a61-49f4-a653-610b3390321a', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a66f48-0a48-4aae-a7a5-40f12275a450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:46 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Volume volume-049fa76a-7a61-49f4-a653-610b3390321a (049fa76a-7a61-49f4-a653-610b3390321a): created successfully Sep 09 17:03:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2a66f48-0a48-4aae-a7a5-40f12275a450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:46 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Flow 'volume_create_manager' (aa6072ed-b78b-4568-ac1c-8c7fcaf07e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2fb78f3f-8dfb-44a9-adf0-a9a72303356d tempest-CinderUnicodeTest-1014587166 None] Created volume successfully. Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Flow 'volume_create_manager' (32e8a81a-1135-45da-a7e9-37805aa822ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8365627-f202-4236-ad70-cb3fa0dae4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8365627-f202-4236-ad70-cb3fa0dae4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1024885144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cac582-7c92-4b49-95b5-3074b16d7164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f24b356e3d343149d6fa2ff3419a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:47Z,use_quota=True,user_id='d99a65514c5b45ffa71cc4671eb90b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc5738e-0ab6-4eda-a2af-89e594308fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fc5738e-0ab6-4eda-a2af-89e594308fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef85fb2-f7bd-4a9e-8a66-68e432c8b7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef85fb2-f7bd-4a9e-8a66-68e432c8b7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61cac582-7c92-4b49-95b5-3074b16d7164', 'volume_name': 'volume-61cac582-7c92-4b49-95b5-3074b16d7164', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d64ed9-8af3-43dd-9509-f2a1eaf560ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8d64ed9-8af3-43dd-9509-f2a1eaf560ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421a4ce4-431b-41ce-ab58-4355dc9d8af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Volume 61cac582-7c92-4b49-95b5-3074b16d7164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61cac582-7c92-4b49-95b5-3074b16d7164', 'volume_size': 1} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:03:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1024885144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cac582-7c92-4b49-95b5-3074b16d7164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f24b356e3d343149d6fa2ff3419a757',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:03:47Z,use_quota=True,user_id='d99a65514c5b45ffa71cc4671eb90b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Creating volume 61cac582-7c92-4b49-95b5-3074b16d7164 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:03:47 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:47 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 1073741824 Sep 09 17:03:47 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:47 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 1073741824" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:47 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 Sep 09 17:03:47 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:47 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164" returned: 0 in 0.230s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] <== create_volume: return (657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.662s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421a4ce4-431b-41ce-ab58-4355dc9d8af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cac582-7c92-4b49-95b5-3074b16d7164', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b9ac1b-9571-4c1e-88e6-6cb24fee3845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:03:47 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Volume volume-61cac582-7c92-4b49-95b5-3074b16d7164 (61cac582-7c92-4b49-95b5-3074b16d7164): created successfully Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b9ac1b-9571-4c1e-88e6-6cb24fee3845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:03:47 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Flow 'volume_create_manager' (32e8a81a-1135-45da-a7e9-37805aa822ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:03:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9e5f5dd0-45ea-43f8-9e01-146ac082ad4d tempest-CinderUnicodeTest-1014587166 None] Created volume successfully. Sep 09 17:03:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:48 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Creating offline snapshot 6888c387-ce0a-4109-b214-6d95adbf2001 of volume 61cac582-7c92-4b49-95b5-3074b16d7164 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:03:48 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[41183877-c0ba-47e8-9dc5-a6acfadf84f9]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:48 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 Sep 09 17:03:48 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:48 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:48 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 1G Sep 09 17:03:48 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:49 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 1G" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61cac582-7c92-4b49-95b5-3074b16d7164 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:49 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61cac582-7c92-4b49-95b5-3074b16d7164 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 Sep 09 17:03:49 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:49 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61cac582-7c92-4b49-95b5-3074b16d7164 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:49 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 is being set with open permissions: ugo+rw Sep 09 17:03:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:49 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 Sep 09 17:03:49 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:49 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:49 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.info Sep 09 17:03:49 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:49 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.info" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:49 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.info is being set with open permissions: ugo+rw Sep 09 17:03:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:49 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.info Sep 09 17:03:49 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:50 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.info" returned: 0 in 0.225s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.779s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-104dc636-1fc7-4fdf-9d25-117d722b5c18 tempest-CinderUnicodeTest-1014587166 None] Create snapshot completed successfully Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "cinder-6888c387-ce0a-4109-b214-6d95adbf2001-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-6888c387-ce0a-4109-b214-6d95adbf2001-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "cinder-quobyte-61cac582-7c92-4b49-95b5-3074b16d7164" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-quobyte-61cac582-7c92-4b49-95b5-3074b16d7164" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "cinder-quobyte-6888c387-ce0a-4109-b214-6d95adbf2001" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-quobyte-6888c387-ce0a-4109-b214-6d95adbf2001" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Deleting offline snapshot 6888c387-ce0a-4109-b214-6d95adbf2001 of volume 61cac582-7c92-4b49-95b5-3074b16d7164 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] snapshot_file for this snap is: volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[951e4623-0999-4b9f-b013-91d4cd0ec2cb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:50 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 Sep 09 17:03:50 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:50 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61cac582-7c92-4b49-95b5-3074b16d7164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf6fd0a-ca24-40b8-a905-90ab330ce470]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:50 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 Sep 09 17:03:50 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:51 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:51 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 Sep 09 17:03:51 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:51 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:51 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001 Sep 09 17:03:51 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:51 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164.6888c387-ce0a-4109-b214-6d95adbf2001" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-quobyte-6888c387-ce0a-4109-b214-6d95adbf2001" released by "_delete_snapshot" :: held 1.317s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-quobyte-61cac582-7c92-4b49-95b5-3074b16d7164" released by "delete_snapshot" :: held 1.337s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:51 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Created reservations ['31323123-78f5-4eb3-a42e-53a4dd6d7478', '0d1d2847-059c-4c3c-926c-9f12ff85a71a', '3ed962e2-c399-4cdd-b018-24a7cc5be01b', 'bc2e1b4e-6e11-4f99-a016-0e6043bbe29e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Delete snapshot completed successfully. Sep 09 17:03:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-99bc99d3-87f6-4f3c-9337-d576876c630a tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-6888c387-ce0a-4109-b214-6d95adbf2001-delete_snapshot" released by "delete_snapshot" :: held 1.454s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "cinder-61cac582-7c92-4b49-95b5-3074b16d7164-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-61cac582-7c92-4b49-95b5-3074b16d7164-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "cinder-quobyte-61cac582-7c92-4b49-95b5-3074b16d7164" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-quobyte-61cac582-7c92-4b49-95b5-3074b16d7164" acquired by "delete_volume" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[940fb929-3f4a-4fa6-b684-7b8f6c146a5e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:52 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 Sep 09 17:03:52 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:53 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164" returned: 0 in 0.341s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:53 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164 Sep 09 17:03:53 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:53 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-61cac582-7c92-4b49-95b5-3074b16d7164" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-quobyte-61cac582-7c92-4b49-95b5-3074b16d7164" released by "delete_volume" :: held 0.630s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Created reservations ['13b44d90-562c-4323-a4d4-2488a9f1a651', 'd2061114-2e88-4013-a9b5-32110715021f', 'd01ef3fc-0494-4b95-8abc-8643f9e00ed2', '5109aada-3239-4b7c-bc8f-7671cdc51acc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:53 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:53 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:53 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Deleted volume successfully. Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fabcb107-d37d-4b35-8b2d-509574d9eb70 tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-61cac582-7c92-4b49-95b5-3074b16d7164-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "cinder-049fa76a-7a61-49f4-a653-610b3390321a-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-049fa76a-7a61-49f4-a653-610b3390321a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "cinder-quobyte-049fa76a-7a61-49f4-a653-610b3390321a" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-quobyte-049fa76a-7a61-49f4-a653-610b3390321a" acquired by "delete_volume" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[121ffbd9-cbd4-4562-8678-5bc1ba32e38a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:03:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:53 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a Sep 09 17:03:53 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:54 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a" returned: 0 in 0.342s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:54 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a Sep 09 17:03:54 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:54 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-049fa76a-7a61-49f4-a653-610b3390321a" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-quobyte-049fa76a-7a61-49f4-a653-610b3390321a" released by "delete_volume" :: held 0.613s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Created reservations ['e9cd4789-4641-46cf-8d1c-0701ab19eb4b', '63eeeb7d-a34a-4aa3-838c-9329b6a8f944', '80ac19b7-5b1c-4f75-9dce-62d76a86b8a3', '12bba3fb-6278-43f3-96f3-46b67b45ee34'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:03:54 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:03:54 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:03:54 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:03:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Deleted volume successfully. Sep 09 17:03:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0184d1ce-b8e0-4b14-b506-a27a449f2bd6 tempest-CinderUnicodeTest-1014587166 None] Lock "cinder-049fa76a-7a61-49f4-a653-610b3390321a-delete_volume" released by "delete_volume" :: held 1.030s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:04 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=78,cinder:INSERT=34,cinder:UPDATE=117,cinder:DELETE=11 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:04:04 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=112,cinder:SELECT=95,cinder:DELETE=9,cinder:INSERT=30 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (3877a06f-ca7e-4df8-be72-629b07ca7a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af387a9a-2402-413b-802d-a167ae71798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af387a9a-2402-413b-802d-a167ae71798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741527097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5b1bb9-f2b2-4726-bcc7-5acc978e362f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:11Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cb2b11-cb9c-47c3-8d4d-5a284501ad53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cb2b11-cb9c-47c3-8d4d-5a284501ad53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50207791-425b-452b-a864-3bec682f475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50207791-425b-452b-a864-3bec682f475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5b1bb9-f2b2-4726-bcc7-5acc978e362f', 'volume_name': 'volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1dbd8c-8011-4abc-9a04-01913a0f0c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff1dbd8c-8011-4abc-9a04-01913a0f0c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc52fd2-2d27-4fba-91d6-d40781c1345d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:10 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume 8c5b1bb9-f2b2-4726-bcc7-5acc978e362f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f', 'volume_size': 1} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1741527097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5b1bb9-f2b2-4726-bcc7-5acc978e362f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:11Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Creating volume 8c5b1bb9-f2b2-4726-bcc7-5acc978e362f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:10 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:10 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f 1073741824 Sep 09 17:04:10 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (de8ffc13-1a65-4386-9120-b55dbd521e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98fcad1-0769-499a-972d-1dc43194a163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d98fcad1-0769-499a-972d-1dc43194a163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1369006480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98aa00a3-0d3b-4ee4-8cea-93030d146cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:11Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:11 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af38e6f-fe45-4b52-927e-da36b1560498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af38e6f-fe45-4b52-927e-da36b1560498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36e3273-8e33-4916-abc8-b5f90b95fd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b36e3273-8e33-4916-abc8-b5f90b95fd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98aa00a3-0d3b-4ee4-8cea-93030d146cad', 'volume_name': 'volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ba01ef-28bd-4a48-8535-a9726536a405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ba01ef-28bd-4a48-8535-a9726536a405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bdddf0-d5c5-470b-a078-f989fc1fbc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume 98aa00a3-0d3b-4ee4-8cea-93030d146cad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad', 'volume_size': 1} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f 1073741824" returned: 0 in 0.665s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:11 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f Sep 09 17:04:11 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:11 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1369006480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98aa00a3-0d3b-4ee4-8cea-93030d146cad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:11Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Creating volume 98aa00a3-0d3b-4ee4-8cea-93030d146cad {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:11 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc52fd2-2d27-4fba-91d6-d40781c1345d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66956eec-aa33-4b66-bf67-c698a429f48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:11 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad 1073741824 Sep 09 17:04:11 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f (8c5b1bb9-f2b2-4726-bcc7-5acc978e362f): created successfully Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66956eec-aa33-4b66-bf67-c698a429f48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (3877a06f-ca7e-4df8-be72-629b07ca7a6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3350c581-21d6-41e5-ad88-9965f12f9ee6 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created volume successfully. Sep 09 17:04:12 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad 1073741824" returned: 0 in 0.483s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:12 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad Sep 09 17:04:12 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:12 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad" returned: 0 in 0.265s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74bdddf0-d5c5-470b-a078-f989fc1fbc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922906ff-3e37-4b03-ba42-be11c8a084c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad (98aa00a3-0d3b-4ee4-8cea-93030d146cad): created successfully Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (922906ff-3e37-4b03-ba42-be11c8a084c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (de8ffc13-1a65-4386-9120-b55dbd521e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a5e42f1a-e6e5-47fd-a0ea-b8615c3fd7d3 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created volume successfully. Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Creating offline snapshot dea4a89d-e082-46d6-84cc-d672d7f22249 of volume 8c5b1bb9-f2b2-4726-bcc7-5acc978e362f {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbb4b52-3e78-46aa-8152-34a233287165]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:13 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f Sep 09 17:04:13 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:13 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:13 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 1G Sep 09 17:04:13 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Flow 'volume_create_manager' (6428040f-aa59-4a96-b0e6-f40a35a0e65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d878412d-99fa-40f4-8aac-c88b00af2bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d878412d-99fa-40f4-8aac-c88b00af2bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff56070-e751-4de6-8720-a7d42114742c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1e144a08f6436197854349e909de56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:13Z,use_quota=True,user_id='4bb32029788f4f7f9959e547eed4ae9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54d976c-3923-48fc-9dbe-8edd5eae25e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f54d976c-3923-48fc-9dbe-8edd5eae25e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:13 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7241e89-3e09-4f9a-991c-fa5562a15d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:13 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 17:04:14 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 1G" returned: 0 in 0.668s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:14 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 Sep 09 17:04:14 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7241e89-3e09-4f9a-991c-fa5562a15d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eff56070-e751-4de6-8720-a7d42114742c', 'volume_name': 'volume-eff56070-e751-4de6-8720-a7d42114742c', 'volume_size': 1, 'image_id': 'f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33ba9dc902c0e02b9f38b71e6bdc5856', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1c1e144a08f6436197854349e909de56', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7fdd1f6a6c44efcbc159af2ba22476d5861ada1f93e209cd6820c3e32acd8d45e56f1d98b403c12a4fc4a59270a6e7c42a27d2fef1e862bc1c24c97eb4e74188', 'id': 'f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'created_at': datetime.datetime(2026, 9, 9, 15, 4, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 4, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f706ae2b-2acb-4ccc-b74d-fcdde9d412dc/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28115b31-f988-41a3-aa19-91972ff327aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28115b31-f988-41a3-aa19-91972ff327aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2035d4ac-8b1c-4af3-8b63-e540458692ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Volume eff56070-e751-4de6-8720-a7d42114742c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eff56070-e751-4de6-8720-a7d42114742c', 'volume_size': 1, 'image_id': 'f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33ba9dc902c0e02b9f38b71e6bdc5856', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1c1e144a08f6436197854349e909de56', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7fdd1f6a6c44efcbc159af2ba22476d5861ada1f93e209cd6820c3e32acd8d45e56f1d98b403c12a4fc4a59270a6e7c42a27d2fef1e862bc1c24c97eb4e74188', 'id': 'f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'created_at': datetime.datetime(2026, 9, 9, 15, 4, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 4, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f706ae2b-2acb-4ccc-b74d-fcdde9d412dc/file', 'properties': {}}, 'image_service': } Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Trying to clone eff56070-e751-4de6-8720-a7d42114742c from image f706ae2b-2acb-4ccc-b74d-fcdde9d412dc at location (None, [{'url': 'file:///opt/stack/data/glance/images/f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (d657dfa1-3ee3-4d33-a1ef-db5ee3a2ea48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430c9e6c-f9ce-4837-bb5f-dad5e2229d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (430c9e6c-f9ce-4837-bb5f-dad5e2229d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26531095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711279a6-9edb-4690-b3a9-a64abc995384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:14Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fc7db9-ed25-4e41-969b-e82d6c08c514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7fc7db9-ed25-4e41-969b-e82d6c08c514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811cff5c-9076-4e77-811d-35b16063692a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (811cff5c-9076-4e77-811d-35b16063692a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711279a6-9edb-4690-b3a9-a64abc995384', 'volume_name': 'volume-711279a6-9edb-4690-b3a9-a64abc995384', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fea12f4-ad1d-4d86-a4d4-e20a4caef43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fea12f4-ad1d-4d86-a4d4-e20a4caef43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29d242c-218e-4c0c-a4e8-bb4509ed1af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume 711279a6-9edb-4690-b3a9-a64abc995384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711279a6-9edb-4690-b3a9-a64abc995384', 'volume_size': 1} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 17:04:14 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Image download 0.00 MB at 0.00 MB/s Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7f55d1-0137-4758-acdd-ba7065526528]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:14 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD Sep 09 17:04:14 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:14 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249" returned: 0 in 0.557s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:14 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 is being set with open permissions: ugo+rw Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:14 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 Sep 09 17:04:14 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (3ffcbe33-19f0-4a01-9d9b-db4408f8e45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa10e033-fcf7-4f47-9d7b-2ad254fbc99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa10e033-fcf7-4f47-9d7b-2ad254fbc99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1808679311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0233b149-a463-4468-aa73-e40e6d18c025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:15Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8993fc9-59db-4f3b-ace3-21e6c2becd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8993fc9-59db-4f3b-ace3-21e6c2becd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07191309-b907-44f0-b6d8-b77a4636c7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07191309-b907-44f0-b6d8-b77a4636c7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0233b149-a463-4468-aa73-e40e6d18c025', 'volume_name': 'volume-0233b149-a463-4468-aa73-e40e6d18c025', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ac38a3-31f2-4e86-b239-7e3de5029e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87ac38a3-31f2-4e86-b239-7e3de5029e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f77a6a-bef8-4608-8e3f-fa343b5aeeab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume 0233b149-a463-4468-aa73-e40e6d18c025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0233b149-a463-4468-aa73-e40e6d18c025', 'volume_size': 1} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:14 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD" returned: 0 in 0.575s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:14 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (deda224e-576e-44ac-8d8c-bfa67f044049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58fb0be-c294-4981-b026-a94f819732fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD Sep 09 17:04:15 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b58fb0be-c294-4981-b026-a94f819732fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573034190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209fd5b8-5729-44d5-9a41-f2259c666c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:15Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028c3d07-cab4-412d-8995-51642bd748c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028c3d07-cab4-412d-8995-51642bd748c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51c7132-7eb7-4262-8c51-dc72ee7bdd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c51c7132-7eb7-4262-8c51-dc72ee7bdd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '209fd5b8-5729-44d5-9a41-f2259c666c7d', 'volume_name': 'volume-209fd5b8-5729-44d5-9a41-f2259c666c7d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1669b1d-bc42-483d-a93e-a43ae5f945de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1669b1d-bc42-483d-a93e-a43ae5f945de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb154d2-483f-483f-a84f-4c0eb171755f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume 209fd5b8-5729-44d5-9a41-f2259c666c7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-209fd5b8-5729-44d5-9a41-f2259c666c7d', 'volume_size': 1} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:15 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.info Sep 09 17:04:15 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:15 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD" returned: 1 in 0.418s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Temporary image f706ae2b-2acb-4ccc-b74d-fcdde9d412dc is fetched for user 4bb32029788f4f7f9959e547eed4ae9a. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[149cab8b-6372-4160-abef-be08b8c6f60a]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:15 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.info" returned: 0 in 0.289s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:15 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.info is being set with open permissions: ugo+rw Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:15 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.info Sep 09 17:04:15 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:15 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD Sep 09 17:04:15 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Flow 'volume_create_manager' (3c72bbbc-06cc-4396-9cbd-82bec2235b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1604fe-c23c-4499-8beb-d7e55e11c9a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e1604fe-c23c-4499-8beb-d7e55e11c9a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f7510d-045f-4bf8-ad26-4b5ca800c9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b9fd8bd20c4bd8854722e76c43d207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:16Z,use_quota=True,user_id='20a2c0ee0d5d46bc98e0e710998176c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a0d400b-e012-48c3-b0ad-a1f6198c6168),volume_type_id=8a0d400b-e012-48c3-b0ad-a1f6198c6168)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86408b65-1cab-416c-9bd8-f8f006c26c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86408b65-1cab-416c-9bd8-f8f006c26c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f506a99-d54d-4f40-a44a-02c14d181b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.image.glance [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Creating Keystone auth plugin from conf {{(pid=87498) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (86c3c87a-1a44-48b0-bed7-711ced9c3a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a95bff8-74c3-4019-b15b-ade61a5f259a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a95bff8-74c3-4019-b15b-ade61a5f259a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1964141534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232a6fe8-47b7-4468-96b6-cdeda87270fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:16Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a150e646-36b4-48a3-9e90-75c70193d96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a150e646-36b4-48a3-9e90-75c70193d96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8005546e-af00-4615-ac94-756e98c3cc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8005546e-af00-4615-ac94-756e98c3cc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '232a6fe8-47b7-4468-96b6-cdeda87270fb', 'volume_name': 'volume-232a6fe8-47b7-4468-96b6-cdeda87270fb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c800741-c498-43bc-9e33-8df48f6bf851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c800741-c498-43bc-9e33-8df48f6bf851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9031d968-c377-4d5c-a4de-1a5fafd9e62b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume 232a6fe8-47b7-4468-96b6-cdeda87270fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-232a6fe8-47b7-4468-96b6-cdeda87270fb', 'volume_size': 1} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:15 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:15 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.info" returned: 0 in 0.407s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.058s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-26531095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711279a6-9edb-4690-b3a9-a64abc995384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:14Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Creating volume 711279a6-9edb-4690-b3a9-a64abc995384 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:15 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:15 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384 1073741824 Sep 09 17:04:16 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:16 devstack sudo[107193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD Sep 09 17:04:16 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9b7f21b7-73c4-473a-bdc7-093e0a94f1fc tempest-CreateVolumesFromSnapshotTest-1561026492 None] Create snapshot completed successfully Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (d723df6e-2787-46c8-b4b9-2bea8af2017d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8816604e-e6c8-487f-85c5-2881b7da3297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8816604e-e6c8-487f-85c5-2881b7da3297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1220053027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8adbd3-db77-488c-9b30-33c2d1ab6db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:16Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578dbb8c-9bba-4d50-9656-38fc7c62245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578dbb8c-9bba-4d50-9656-38fc7c62245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae6c462-ce3a-494e-bbfd-966d00b03ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae6c462-ce3a-494e-bbfd-966d00b03ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8adbd3-db77-488c-9b30-33c2d1ab6db8', 'volume_name': 'volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0be22b5-95e8-471c-904f-4e55e364a95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0be22b5-95e8-471c-904f-4e55e364a95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47242ab-1a76-4dc3-9ea9-570e06fe7800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume 2d8adbd3-db77-488c-9b30-33c2d1ab6db8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8', 'volume_size': 1} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f506a99-d54d-4f40-a44a-02c14d181b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29f7510d-045f-4bf8-ad26-4b5ca800c9a2', 'volume_name': 'volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2', 'volume_size': 1, 'image_id': '665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57a7e9da476f7578146044e7c3e68db5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f7b9fd8bd20c4bd8854722e76c43d207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bffa003e0f01676af26d64a1faea7108415018ef7d5f8bc264d56fef3c5d649d3dd091cbb25c54a1766fd1f43d125806cfcefc5b75747f6aa5103111c1ee958b', 'id': '665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'created_at': datetime.datetime(2026, 9, 9, 15, 4, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 4, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/665e61bc-6a7a-46cd-a5d6-f13f33ff01dc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef32b74-0b6a-4666-b39f-b92c407d36f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ef32b74-0b6a-4666-b39f-b92c407d36f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e0c5d6-186d-4f37-b729-850a7fb06867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Volume 29f7510d-045f-4bf8-ad26-4b5ca800c9a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2', 'volume_size': 1, 'image_id': '665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57a7e9da476f7578146044e7c3e68db5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f7b9fd8bd20c4bd8854722e76c43d207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bffa003e0f01676af26d64a1faea7108415018ef7d5f8bc264d56fef3c5d649d3dd091cbb25c54a1766fd1f43d125806cfcefc5b75747f6aa5103111c1ee958b', 'id': '665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'created_at': datetime.datetime(2026, 9, 9, 15, 4, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 4, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/665e61bc-6a7a-46cd-a5d6-f13f33ff01dc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Trying to clone 29f7510d-045f-4bf8-ad26-4b5ca800c9a2 from image 665e61bc-6a7a-46cd-a5d6-f13f33ff01dc at location (None, [{'url': 'file:///opt/stack/data/glance/images/665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'metadata': {}}]). {{(pid=87498) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 09 17:04:16 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD" returned: 1 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 09 17:04:16 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Image download 0.00 MB at 0.00 MB/s Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652e8a7-eb6e-45df-aa2e-e807a0a8d207]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:16 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD Sep 09 17:04:16 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:16 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384 1073741824" returned: 0 in 0.546s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:16 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384 Sep 09 17:04:16 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:16 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (93a8203a-2493-49ba-b369-764142a524c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8eb4c07-3f4b-4750-81a5-ed6ada67d620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8eb4c07-3f4b-4750-81a5-ed6ada67d620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1356024424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f02427d-c1c6-4b08-b4d9-367e85440096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:17Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5af49ba-fdde-408c-85cf-d7a5fc78b803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5af49ba-fdde-408c-85cf-d7a5fc78b803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8a749e-820d-42e9-9570-e472f729020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c8a749e-820d-42e9-9570-e472f729020f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f02427d-c1c6-4b08-b4d9-367e85440096', 'volume_name': 'volume-6f02427d-c1c6-4b08-b4d9-367e85440096', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009e086b-a740-4ec9-8088-e2a6d7deba78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (009e086b-a740-4ec9-8088-e2a6d7deba78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1596329-7062-446d-b683-ade07f0df5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume 6f02427d-c1c6-4b08-b4d9-367e85440096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f02427d-c1c6-4b08-b4d9-367e85440096', 'volume_size': 1} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384" returned: 0 in 0.314s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.095s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1808679311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0233b149-a463-4468-aa73-e40e6d18c025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:15Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Creating volume 0233b149-a463-4468-aa73-e40e6d18c025 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:16 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29d242c-218e-4c0c-a4e8-bb4509ed1af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711279a6-9edb-4690-b3a9-a64abc995384', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025 1073741824 Sep 09 17:04:16 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6389cab7-3cbe-4238-b91f-ef367f3e2b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:16 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume volume-711279a6-9edb-4690-b3a9-a64abc995384 (711279a6-9edb-4690-b3a9-a64abc995384): created successfully Sep 09 17:04:16 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD Sep 09 17:04:16 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6389cab7-3cbe-4238-b91f-ef367f3e2b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:16 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (d657dfa1-3ee3-4d33-a1ef-db5ee3a2ea48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8508f4c3-454e-4155-b319-10ccb71bfa99 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created volume successfully. Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (fa2b4417-da2d-4094-b454-5bad2cdd8fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a43832-cdc1-47d3-9ce2-edd38f437ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66a43832-cdc1-47d3-9ce2-edd38f437ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-380237133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1125957d-bb63-4322-977b-e68b2f354032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:17Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f29d647-6c1d-4e27-9cf5-85412d1b5d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f29d647-6c1d-4e27-9cf5-85412d1b5d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b8f484-cf75-43af-a8b0-b66c6bfac871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b8f484-cf75-43af-a8b0-b66c6bfac871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1125957d-bb63-4322-977b-e68b2f354032', 'volume_name': 'volume-1125957d-bb63-4322-977b-e68b2f354032', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef638fac-b5bb-4f4b-898c-7cabbe4106db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef638fac-b5bb-4f4b-898c-7cabbe4106db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:17 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3ee45d-b50d-44aa-b528-514e91c827e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume 1125957d-bb63-4322-977b-e68b2f354032: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1125957d-bb63-4322-977b-e68b2f354032', 'volume_size': 1} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD" returned: 1 in 0.589s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Temporary image 665e61bc-6a7a-46cd-a5d6-f13f33ff01dc is fetched for user 20a2c0ee0d5d46bc98e0e710998176c6. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 09 17:04:17 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4313e583-db49-4147-b83d-a731d1cd6688]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025 1073741824" returned: 0 in 0.615s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (295118d2-7897-4dfe-a746-aaae16e28747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64eb6ae6-f685-421a-86f0-80a6477707ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64eb6ae6-f685-421a-86f0-80a6477707ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040985645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0f0bfe-5238-4f32-9b15-e7351a49086f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:17Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa02199d-2d8d-4b1a-a9dd-7e9c7365a81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025 Sep 09 17:04:17 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa02199d-2d8d-4b1a-a9dd-7e9c7365a81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e5273f-db56-4e4c-aa94-ce646fab3fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e5273f-db56-4e4c-aa94-ce646fab3fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b0f0bfe-5238-4f32-9b15-e7351a49086f', 'volume_name': 'volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739e1073-4ea8-4f15-8c03-9029a3813bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD Sep 09 17:04:17 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (739e1073-4ea8-4f15-8c03-9029a3813bf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35c6c09-7e8c-42d3-b07a-6266208406f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume 1b0f0bfe-5238-4f32-9b15-e7351a49086f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f', 'volume_size': 1} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:17 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:17 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.701s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-573034190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209fd5b8-5729-44d5-9a41-f2259c666c7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:15Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Creating volume 209fd5b8-5729-44d5-9a41-f2259c666c7d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:17 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:17 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d 1073741824 Sep 09 17:04:17 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4f77a6a-bef8-4608-8e3f-fa343b5aeeab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0233b149-a463-4468-aa73-e40e6d18c025', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af17c74-9af9-4383-9951-763f0b100b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:17 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume volume-0233b149-a463-4468-aa73-e40e6d18c025 (0233b149-a463-4468-aa73-e40e6d18c025): created successfully Sep 09 17:04:17 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af17c74-9af9-4383-9951-763f0b100b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (3ffcbe33-19f0-4a01-9d9b-db4408f8e45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (aa30f299-b674-4c62-a526-a9805785af72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e388dba-1ee0-4a33-96a6-7af8a9f89706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e388dba-1ee0-4a33-96a6-7af8a9f89706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-762388817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c457ada-9099-4743-ad03-296d98ab8d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:18Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa959f8-41e2-47e7-8076-2acc94c411a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD Sep 09 17:04:18 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa959f8-41e2-47e7-8076-2acc94c411a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5dc2e2-ac36-419d-9584-ac72cad0af91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f5dc2e2-ac36-419d-9584-ac72cad0af91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c457ada-9099-4743-ad03-296d98ab8d1c', 'volume_name': 'volume-7c457ada-9099-4743-ad03-296d98ab8d1c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606930d9-3d8a-4917-a5b5-737664da0ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606930d9-3d8a-4917-a5b5-737664da0ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1692eb0-025c-41ee-be0d-4c690939cbb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume 7c457ada-9099-4743-ad03-296d98ab8d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c457ada-9099-4743-ad03-296d98ab8d1c', 'volume_size': 1} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bcc268ea-c68c-4e9f-8322-4edb96044047 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created volume successfully. Sep 09 17:04:18 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD" returned: 1 in 0.450s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (ab906508-8213-4127-b426-e2475b852e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9cceb0e-4cbf-4e0c-8992-9452a4c99df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9cceb0e-4cbf-4e0c-8992-9452a4c99df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-411264417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0833bf3a-d42c-4c69-8043-5e2722f01fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:18Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808bd0f4-1a42-4e31-806a-4d80075a3c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808bd0f4-1a42-4e31-806a-4d80075a3c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f52654-49ef-4e2a-809b-94720705e089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37f52654-49ef-4e2a-809b-94720705e089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0833bf3a-d42c-4c69-8043-5e2722f01fa1', 'volume_name': 'volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933ce744-3b6a-4177-a1cb-b28b3bbcd155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (933ce744-3b6a-4177-a1cb-b28b3bbcd155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24875d1b-a078-4305-9147-1c545cd6b96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume 0833bf3a-d42c-4c69-8043-5e2722f01fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1', 'volume_size': 1} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d 1073741824" returned: 0 in 0.621s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:18 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d Sep 09 17:04:18 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:18 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.990s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1964141534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=232a6fe8-47b7-4468-96b6-cdeda87270fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:16Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Creating volume 232a6fe8-47b7-4468-96b6-cdeda87270fb {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:18 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb154d2-483f-483f-a84f-4c0eb171755f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209fd5b8-5729-44d5-9a41-f2259c666c7d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb 1073741824 Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9d6a6c-a840-41d4-b697-1c7d58474271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:18 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:18 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume volume-209fd5b8-5729-44d5-9a41-f2259c666c7d (209fd5b8-5729-44d5-9a41-f2259c666c7d): created successfully Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb9d6a6c-a840-41d4-b697-1c7d58474271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:18 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (deda224e-576e-44ac-8d8c-bfa67f044049) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-673040d4-65b2-4f1b-9d78-bd7053508415 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created volume successfully. Sep 09 17:04:19 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb 1073741824" returned: 0 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:19 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb Sep 09 17:04:19 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:19 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.371s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1220053027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8adbd3-db77-488c-9b30-33c2d1ab6db8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='810e9f25f04c441d92db6b37ea7ee11f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:16Z,use_quota=True,user_id='bf9b2618254547068309ff4fd06729cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Creating volume 2d8adbd3-db77-488c-9b30-33c2d1ab6db8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:19 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9031d968-c377-4d5c-a4de-1a5fafd9e62b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-232a6fe8-47b7-4468-96b6-cdeda87270fb', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc4e129-b2c7-46e3-beb4-bfe36ee76311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:19 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8 1073741824 Sep 09 17:04:19 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:19 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume volume-232a6fe8-47b7-4468-96b6-cdeda87270fb (232a6fe8-47b7-4468-96b6-cdeda87270fb): created successfully Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fc4e129-b2c7-46e3-beb4-bfe36ee76311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (86c3c87a-1a44-48b0-bed7-711ced9c3a4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e443bcf9-e37b-49aa-ac08-5bf351179573 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created volume successfully. Sep 09 17:04:19 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8 1073741824" returned: 0 in 0.409s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:19 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8 Sep 09 17:04:19 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:20 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.910s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff56070-e751-4de6-8720-a7d42114742c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c1e144a08f6436197854349e909de56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:13Z,use_quota=True,user_id='4bb32029788f4f7f9959e547eed4ae9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Creating volume eff56070-e751-4de6-8720-a7d42114742c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d47242ab-1a76-4dc3-9ea9-570e06fe7800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae62657-1080-4c4d-a8b9-116fa99ed0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:20 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c 1073741824 Sep 09 17:04:20 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Volume volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8 (2d8adbd3-db77-488c-9b30-33c2d1ab6db8): created successfully Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ae62657-1080-4c4d-a8b9-116fa99ed0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Flow 'volume_create_manager' (d723df6e-2787-46c8-b4b9-2bea8af2017d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:20 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7777bfe5-388c-4210-b810-075009b8db09 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created volume successfully. Sep 09 17:04:20 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c 1073741824" returned: 0 in 0.430s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:20 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c Sep 09 17:04:20 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-2d8adbd3-db77-488c-9b30-33c2d1ab6db8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-2d8adbd3-db77-488c-9b30-33c2d1ab6db8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-quobyte-2d8adbd3-db77-488c-9b30-33c2d1ab6db8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-2d8adbd3-db77-488c-9b30-33c2d1ab6db8" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[569e5cb6-20cb-4ffc-a8d8-5f4af7af3658]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:20 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8 Sep 09 17:04:20 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:20 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.073s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1356024424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f02427d-c1c6-4b08-b4d9-367e85440096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:17Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Creating volume 6f02427d-c1c6-4b08-b4d9-367e85440096 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:20 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096 1073741824 Sep 09 17:04:20 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Attempting download of f706ae2b-2acb-4ccc-b74d-fcdde9d412dc ((None, [{'url': 'file:///opt/stack/data/glance/images/f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'metadata': {}}])) to volume eff56070-e751-4de6-8720-a7d42114742c. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1197}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2d7502-01a9-4dfc-b56b-6343e390e5ea]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_v6ix6ojq {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:21 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_v6ix6ojq Sep 09 17:04:21 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:21 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8" returned: 0 in 0.380s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:21 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8 Sep 09 17:04:21 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:21 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096 1073741824" returned: 0 in 0.446s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:21 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_v6ix6ojq" returned: 0 in 0.377s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_v6ix6ojq {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:21 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d8adbd3-db77-488c-9b30-33c2d1ab6db8" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:21 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096 Sep 09 17:04:21 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-2d8adbd3-db77-488c-9b30-33c2d1ab6db8" released by "delete_volume" :: held 0.716s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:21 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_v6ix6ojq Sep 09 17:04:21 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created reservations ['a418841b-9c3d-4ed2-bb19-2710a0c757b3', '59f73ebf-af1d-43a0-a78d-935c8b1292f1', 'fd77d80e-19d5-4d74-8302-7f861efeea05', 'f6ff7854-5180-4675-8ce8-8c295b869016'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:21 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:21 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:21 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096" returned: 0 in 0.295s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.382s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-380237133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1125957d-bb63-4322-977b-e68b2f354032,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:17Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Creating volume 1125957d-bb63-4322-977b-e68b2f354032 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:21 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1596329-7062-446d-b683-ade07f0df5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f02427d-c1c6-4b08-b4d9-367e85440096', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:21 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032 1073741824 Sep 09 17:04:21 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1faaed3e-17bc-4f42-8c32-1a112508e4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_v6ix6ojq" returned: 1 in 0.397s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_v6ix6ojq' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dd1bc8-3013-489b-a08c-071b23113247]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume volume-6f02427d-c1c6-4b08-b4d9-367e85440096 (6f02427d-c1c6-4b08-b4d9-367e85440096): created successfully Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1faaed3e-17bc-4f42-8c32-1a112508e4b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (93a8203a-2493-49ba-b369-764142a524c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-93190d3a-7909-4aee-927e-bf07cf1a1dcd tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created volume successfully. Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-232a6fe8-47b7-4468-96b6-cdeda87270fb-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:21 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Deleted volume successfully. Sep 09 17:04:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-232a6fe8-47b7-4468-96b6-cdeda87270fb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-93096e18-3c6f-4031-899b-f028628e6bc2 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-2d8adbd3-db77-488c-9b30-33c2d1ab6db8-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:22 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD Sep 09 17:04:22 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-quobyte-232a6fe8-47b7-4468-96b6-cdeda87270fb" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-232a6fe8-47b7-4468-96b6-cdeda87270fb" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1a1656-1842-4bca-8397-6ea1b1baabc0]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:22 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb Sep 09 17:04:22 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:22 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:22 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032 1073741824" returned: 0 in 0.493s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:22 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032 Sep 09 17:04:22 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:22 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD Sep 09 17:04:22 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:22 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:22 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb Sep 09 17:04:22 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:22 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032" returned: 0 in 0.302s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.970s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2040985645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b0f0bfe-5238-4f32-9b15-e7351a49086f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:17Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Creating volume 1b0f0bfe-5238-4f32-9b15-e7351a49086f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:22 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:22 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] f706ae2b-2acb-4ccc-b74d-fcdde9d412dc was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:22 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f 1073741824 Sep 09 17:04:22 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a3ee45d-b50d-44aa-b528-514e91c827e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1125957d-bb63-4322-977b-e68b2f354032', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:22 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c Sep 09 17:04:22 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41648a56-7e1a-457d-8a45-7228f33e8182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume volume-1125957d-bb63-4322-977b-e68b2f354032 (1125957d-bb63-4322-977b-e68b2f354032): created successfully Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41648a56-7e1a-457d-8a45-7228f33e8182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (fa2b4417-da2d-4094-b454-5bad2cdd8fd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bce44e7f-635f-41b3-a33c-f43f4abe08d4 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created volume successfully. Sep 09 17:04:22 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-232a6fe8-47b7-4468-96b6-cdeda87270fb" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-232a6fe8-47b7-4468-96b6-cdeda87270fb" released by "delete_volume" :: held 0.762s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created reservations ['68577a51-9776-44e9-9ec4-53af8a3d64f8', '9ec70cba-3287-41fb-948b-9235d3f43351', 'f56331cc-bd52-43eb-a1aa-caa3717c4586', '21659ff3-a62e-4911-b874-bba7d7407b57'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:22 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:22 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:23 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f 1073741824" returned: 0 in 0.485s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-209fd5b8-5729-44d5-9a41-f2259c666c7d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:23 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c" returned: 0 in 0.531s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f706ae2b-2acb-4ccc-b74d-fcdde9d412dc_esjz2jhzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:04:23 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 17:04:23 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:23 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-209fd5b8-5729-44d5-9a41-f2259c666c7d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:23 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c 1G Sep 09 17:04:23 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:23 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Deleted volume successfully. Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-quobyte-209fd5b8-5729-44d5-9a41-f2259c666c7d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-b4345f41-21e4-44ca-a05f-adf65679c384 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-232a6fe8-47b7-4468-96b6-cdeda87270fb-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-209fd5b8-5729-44d5-9a41-f2259c666c7d" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3f0c93-245a-4ce7-8c46-2e9c32aa5236]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:23 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d Sep 09 17:04:23 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:23 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f" returned: 0 in 0.333s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.341s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-762388817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c457ada-9099-4743-ad03-296d98ab8d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:18Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Creating volume 7c457ada-9099-4743-ad03-296d98ab8d1c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:23 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:23 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c 1073741824 Sep 09 17:04:23 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e35c6c09-7e8c-42d3-b07a-6266208406f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d77fa5-ed6a-471c-96b5-99cbbadfb15f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f (1b0f0bfe-5238-4f32-9b15-e7351a49086f): created successfully Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53d77fa5-ed6a-471c-96b5-99cbbadfb15f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (295118d2-7897-4dfe-a746-aaae16e28747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9ce0a6ea-05c0-461f-ba1d-0003683e4b71 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created volume successfully. Sep 09 17:04:23 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c 1G" returned: 0 in 0.419s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Downloaded image f706ae2b-2acb-4ccc-b74d-fcdde9d412dc ((None, [{'url': 'file:///opt/stack/data/glance/images/f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'metadata': {}}])) to volume eff56070-e751-4de6-8720-a7d42114742c successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1242}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Temporary image f706ae2b-2acb-4ccc-b74d-fcdde9d412dc for user 4bb32029788f4f7f9959e547eed4ae9a is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Marking volume eff56070-e751-4de6-8720-a7d42114742c as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1146}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Copying metadata from image f706ae2b-2acb-4ccc-b74d-fcdde9d412dc to eff56070-e751-4de6-8720-a7d42114742c. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Creating volume glance metadata for volume eff56070-e751-4de6-8720-a7d42114742c backed by image f706ae2b-2acb-4ccc-b74d-fcdde9d412dc with: {'image_id': 'f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '33ba9dc902c0e02b9f38b71e6bdc5856', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2035d4ac-8b1c-4af3-8b63-e540458692ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff56070-e751-4de6-8720-a7d42114742c', 'volume_size': 1, 'image_id': 'f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '33ba9dc902c0e02b9f38b71e6bdc5856', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1c1e144a08f6436197854349e909de56', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7fdd1f6a6c44efcbc159af2ba22476d5861ada1f93e209cd6820c3e32acd8d45e56f1d98b403c12a4fc4a59270a6e7c42a27d2fef1e862bc1c24c97eb4e74188', 'id': 'f706ae2b-2acb-4ccc-b74d-fcdde9d412dc', 'created_at': datetime.datetime(2026, 9, 9, 15, 4, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 4, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f706ae2b-2acb-4ccc-b74d-fcdde9d412dc/file', 'properties': {}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41baf05b-5c98-4f2d-a29c-fa55319c3545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:23 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Volume volume-eff56070-e751-4de6-8720-a7d42114742c (eff56070-e751-4de6-8720-a7d42114742c): created successfully Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41baf05b-5c98-4f2d-a29c-fa55319c3545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Flow 'volume_create_manager' (6428040f-aa59-4a96-b0e6-f40a35a0e65f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:23 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d" returned: 0 in 0.461s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b5e707a4-1c6f-4e77-a1c0-9c1e8a1c8ad0 tempest-VolumeImageDependencyTests-2061320701 None] Created volume successfully. Sep 09 17:04:23 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d Sep 09 17:04:23 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:24 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c 1073741824" returned: 0 in 0.531s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:24 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-209fd5b8-5729-44d5-9a41-f2259c666c7d" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:24 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c Sep 09 17:04:24 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-209fd5b8-5729-44d5-9a41-f2259c666c7d" released by "delete_volume" :: held 0.818s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created reservations ['330a61af-62eb-4a72-9f1b-2f9dc565026a', 'a5c87241-58ef-4ab0-994a-558ac5f44643', 'cfa78a90-75eb-41f9-a70a-4f85d2c0a5b7', '60fd0c3b-cb57-439b-bddd-6ad59750d569'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:24 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:24 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-0233b149-a463-4468-aa73-e40e6d18c025-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:24 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-0233b149-a463-4468-aa73-e40e6d18c025-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29f7510d-045f-4bf8-ad26-4b5ca800c9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7b9fd8bd20c4bd8854722e76c43d207',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:16Z,use_quota=True,user_id='20a2c0ee0d5d46bc98e0e710998176c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8a0d400b-e012-48c3-b0ad-a1f6198c6168),volume_type_id=8a0d400b-e012-48c3-b0ad-a1f6198c6168)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Creating volume 29f7510d-045f-4bf8-ad26-4b5ca800c9a2 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:24 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:24 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 1073741824 Sep 09 17:04:24 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1692eb0-025c-41ee-be0d-4c690939cbb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c457ada-9099-4743-ad03-296d98ab8d1c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a30e210-292d-4f4c-8513-408ef43c948d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume volume-7c457ada-9099-4743-ad03-296d98ab8d1c (7c457ada-9099-4743-ad03-296d98ab8d1c): created successfully Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a30e210-292d-4f4c-8513-408ef43c948d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (aa30f299-b674-4c62-a526-a9805785af72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-quobyte-0233b149-a463-4468-aa73-e40e6d18c025" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-da239d27-35e1-4d5c-9d26-8a9377298fa1 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created volume successfully. Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-0233b149-a463-4468-aa73-e40e6d18c025" acquired by "delete_volume" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:24 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Deleted volume successfully. Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda53feb-be55-4445-b31d-96b36f1c9416]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-e54ee385-9372-4ce1-8f26-6b4ca4cab40c tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-209fd5b8-5729-44d5-9a41-f2259c666c7d-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:24 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025 Sep 09 17:04:24 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Acquiring lock "cinder-eff56070-e751-4de6-8720-a7d42114742c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Lock "cinder-eff56070-e751-4de6-8720-a7d42114742c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Acquiring lock "cinder-quobyte-eff56070-e751-4de6-8720-a7d42114742c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Lock "cinder-quobyte-eff56070-e751-4de6-8720-a7d42114742c" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f32ef89-24e5-4d2f-8f9a-6a733a539b90]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:25 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 1073741824" returned: 0 in 0.609s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:25 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025" returned: 0 in 0.527s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:25 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c Sep 09 17:04:25 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:25 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 Sep 09 17:04:25 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:25 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025 Sep 09 17:04:25 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:25 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.841s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-411264417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0833bf3a-d42c-4c69-8043-5e2722f01fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f7e2650a431432991fe9f5ca859965d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:18Z,use_quota=True,user_id='5f648c817dd64c09bcd18067100fe734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Creating volume 0833bf3a-d42c-4c69-8043-5e2722f01fa1 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:25 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:25 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1 1073741824 Sep 09 17:04:25 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:25 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c" returned: 0 in 0.439s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Attempting download of 665e61bc-6a7a-46cd-a5d6-f13f33ff01dc ((None, [{'url': 'file:///opt/stack/data/glance/images/665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'metadata': {}}])) to volume 29f7510d-045f-4bf8-ad26-4b5ca800c9a2. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1197}} Sep 09 17:04:25 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:25 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c Sep 09 17:04:25 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0233b149-a463-4468-aa73-e40e6d18c025" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-0233b149-a463-4468-aa73-e40e6d18c025" released by "delete_volume" :: held 0.974s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c37115-8f78-45a6-b760-c9104578f0a8]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_lvx9skqm {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created reservations ['1226b500-7547-4702-8ada-0c0a921bd789', '0db3a92b-d329-44e3-bdd8-612fa6adf13f', 'a4f4453b-e534-4ee7-ad1d-a4119cf44114', '204213d9-4038-4a85-9e41-c5d96d3db049'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:25 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_lvx9skqm Sep 09 17:04:25 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:25 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-eff56070-e751-4de6-8720-a7d42114742c" returned: 0 in 0.315s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Lock "cinder-quobyte-eff56070-e751-4de6-8720-a7d42114742c" released by "delete_volume" :: held 0.811s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:25 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:25 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Created reservations ['d0102a46-2e80-460f-baa3-0c0ae6da8c75', '5e40e724-e2bd-4559-85d2-96ffbac8ec13', '0e051971-1175-42ec-93c6-6e7333941388', 'a61b472f-e3a2-4319-9de4-74594d7ce0bc'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:26 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1 1073741824" returned: 0 in 0.691s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:26 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_lvx9skqm" returned: 0 in 0.580s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_lvx9skqm {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:26 devstack sudo[107406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:26 devstack sudo[107406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:26 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1 Sep 09 17:04:26 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:26 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.546s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:26 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_lvx9skqm Sep 09 17:04:26 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Deleted volume successfully. Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f4a41f6a-2a4f-46a0-81f1-a43b8e02ea18 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-0233b149-a463-4468-aa73-e40e6d18c025-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:26 devstack sudo[107406]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.442s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Deleted volume successfully. Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-79ac1c9d-9431-4ded-844e-160495399c48 tempest-VolumeImageDependencyTests-2061320701 None] Lock "cinder-eff56070-e751-4de6-8720-a7d42114742c-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:26 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24875d1b-a078-4305-9147-1c545cd6b96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc45e7b-72d1-439d-b8e0-6717a8827ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:26 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Volume volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1 (0833bf3a-d42c-4c69-8043-5e2722f01fa1): created successfully Sep 09 17:04:26 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc45e7b-72d1-439d-b8e0-6717a8827ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Flow 'volume_create_manager' (ab906508-8213-4127-b426-e2475b852e3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_lvx9skqm" returned: 1 in 0.530s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_lvx9skqm' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc2f33f-ba12-4a51-9921-7078791af993]: (4, 'raw') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6b4ce75f-b5bb-4d4a-84b8-66852495c765 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created volume successfully. Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-711279a6-9edb-4690-b3a9-a64abc995384-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-711279a6-9edb-4690-b3a9-a64abc995384-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-quobyte-711279a6-9edb-4690-b3a9-a64abc995384" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-711279a6-9edb-4690-b3a9-a64abc995384" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[79956302-e51d-40cc-be0c-bdb741d5ecaf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:26 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD Sep 09 17:04:26 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:26 devstack sudo[107419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384 Sep 09 17:04:26 devstack sudo[107419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:27 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:27 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD Sep 09 17:04:27 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:27 devstack sudo[107419]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:27 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384 Sep 09 17:04:27 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-0833bf3a-d42c-4c69-8043-5e2722f01fa1-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-0833bf3a-d42c-4c69-8043-5e2722f01fa1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:27 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD" returned: 1 in 0.375s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] 665e61bc-6a7a-46cd-a5d6-f13f33ff01dc was raw, converting to qcow2 {{(pid=87498) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:27 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 Sep 09 17:04:27 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-quobyte-0833bf3a-d42c-4c69-8043-5e2722f01fa1" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-0833bf3a-d42c-4c69-8043-5e2722f01fa1" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[19879fdb-34f5-477b-bfc3-2082b7abf079]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:27 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-711279a6-9edb-4690-b3a9-a64abc995384" returned: 0 in 0.386s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-711279a6-9edb-4690-b3a9-a64abc995384" released by "delete_volume" :: held 0.845s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:27 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1 Sep 09 17:04:27 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created reservations ['398bfca9-f37b-4d28-bc0e-0ddbc43bf02b', '432b1cae-d558-4098-b458-31790193e071', 'fcc1825b-0250-4836-91fb-13303dc52f21', '4d9b1305-0f1d-4a04-9b1e-d3ac10edd9b3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:27 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:27 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-98aa00a3-0d3b-4ee4-8cea-93030d146cad-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-98aa00a3-0d3b-4ee4-8cea-93030d146cad-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "cinder-quobyte-98aa00a3-0d3b-4ee4-8cea-93030d146cad" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-98aa00a3-0d3b-4ee4-8cea-93030d146cad" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:28 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2" returned: 0 in 0.663s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_665e61bc-6a7a-46cd-a5d6-f13f33ff01dc_yh81elusdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:04:28 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Converted 0.00 MB image at 0.00 MB/s Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[5684cc60-be4a-4fbf-a12d-f24f283e83a1]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:28 devstack sudo[107448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 1G Sep 09 17:04:28 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:28 devstack sudo[107448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1" returned: 0 in 0.599s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:28 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1 Sep 09 17:04:28 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:28 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad Sep 09 17:04:28 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:28 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.509s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Deleted volume successfully. Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-290b4e4a-748e-4a9e-884b-a7530d76236b tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-711279a6-9edb-4690-b3a9-a64abc995384-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:28 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-0833bf3a-d42c-4c69-8043-5e2722f01fa1" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-0833bf3a-d42c-4c69-8043-5e2722f01fa1" released by "delete_volume" :: held 1.009s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created reservations ['3f4a2187-b049-49ff-9bc4-a03fec2cda18', '6dbe495b-4877-4e8c-a038-27fb2d3187ad', '3452e985-ac32-437c-84d5-6278cb3c315f', '5e82f4b0-9dde-4472-bd65-56a024cd31d2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:28 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad" returned: 0 in 0.521s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:28 devstack sudo[107448]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 1G" returned: 0 in 0.561s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Downloaded image 665e61bc-6a7a-46cd-a5d6-f13f33ff01dc ((None, [{'url': 'file:///opt/stack/data/glance/images/665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'metadata': {}}])) to volume 29f7510d-045f-4bf8-ad26-4b5ca800c9a2 successfully. {{(pid=87498) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1242}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Temporary image 665e61bc-6a7a-46cd-a5d6-f13f33ff01dc for user 20a2c0ee0d5d46bc98e0e710998176c6 is deleted. {{(pid=87498) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.volume.volume_utils [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Marking volume 29f7510d-045f-4bf8-ad26-4b5ca800c9a2 as bootable. {{(pid=87498) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1146}} Sep 09 17:04:28 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad Sep 09 17:04:28 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Copying metadata from image 665e61bc-6a7a-46cd-a5d6-f13f33ff01dc to 29f7510d-045f-4bf8-ad26-4b5ca800c9a2. {{(pid=87498) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Creating volume glance metadata for volume 29f7510d-045f-4bf8-ad26-4b5ca800c9a2 backed by image 665e61bc-6a7a-46cd-a5d6-f13f33ff01dc with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '57a7e9da476f7578146044e7c3e68db5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87498) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:28 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:28 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e0c5d6-186d-4f37-b729-850a7fb06867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2', 'volume_size': 1, 'image_id': '665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '57a7e9da476f7578146044e7c3e68db5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f7b9fd8bd20c4bd8854722e76c43d207', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bffa003e0f01676af26d64a1faea7108415018ef7d5f8bc264d56fef3c5d649d3dd091cbb25c54a1766fd1f43d125806cfcefc5b75747f6aa5103111c1ee958b', 'id': '665e61bc-6a7a-46cd-a5d6-f13f33ff01dc', 'created_at': datetime.datetime(2026, 9, 9, 15, 4, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 9, 15, 4, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/665e61bc-6a7a-46cd-a5d6-f13f33ff01dc/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6387ca85-fc26-46ce-ab84-ba1ca2cd3d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Volume volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 (29f7510d-045f-4bf8-ad26-4b5ca800c9a2): created successfully Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6387ca85-fc26-46ce-ab84-ba1ca2cd3d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Flow 'volume_create_manager' (3c72bbbc-06cc-4396-9cbd-82bec2235b6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0821edd8-cd9d-4f77-b2c4-6a56a171a90a tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Created volume successfully. Sep 09 17:04:28 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-98aa00a3-0d3b-4ee4-8cea-93030d146cad" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-quobyte-98aa00a3-0d3b-4ee4-8cea-93030d146cad" released by "delete_volume" :: held 0.932s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:29 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Created reservations ['05723b84-faea-4bcd-b7db-6dc49087fe8e', 'd9213014-6bcf-4245-b335-4d1559689f1d', '8a13b15a-1750-4727-8db5-d7ac149513c7', '063fbbed-120f-48a3-88a0-0810ad972c14'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.297s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Deleted volume successfully. Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d5cc98cf-21ea-42ec-89a6-d53b12a1340e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-0833bf3a-d42c-4c69-8043-5e2722f01fa1-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:29 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:29 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Acquiring lock "cinder-29f7510d-045f-4bf8-ad26-4b5ca800c9a2-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:29 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Lock "cinder-29f7510d-045f-4bf8-ad26-4b5ca800c9a2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Deleted volume successfully. Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-34e4eb21-3a87-4515-8a22-d78d8286b5f6 tempest-CreateVolumesFromSourceVolumeTest-1834998002 None] Lock "cinder-98aa00a3-0d3b-4ee4-8cea-93030d146cad-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Acquiring lock "cinder-quobyte-29f7510d-045f-4bf8-ad26-4b5ca800c9a2" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Lock "cinder-quobyte-29f7510d-045f-4bf8-ad26-4b5ca800c9a2" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15d152b-5dad-454d-a14b-a177915a8091]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:29 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 Sep 09 17:04:29 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-7c457ada-9099-4743-ad03-296d98ab8d1c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-7c457ada-9099-4743-ad03-296d98ab8d1c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-quobyte-7c457ada-9099-4743-ad03-296d98ab8d1c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-7c457ada-9099-4743-ad03-296d98ab8d1c" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fbe2c0-ed09-4205-b3ad-f11c710813ef]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:29 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2" returned: 0 in 0.400s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:29 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c Sep 09 17:04:29 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:29 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2 Sep 09 17:04:29 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:30 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-29f7510d-045f-4bf8-ad26-4b5ca800c9a2" returned: 0 in 0.326s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Lock "cinder-quobyte-29f7510d-045f-4bf8-ad26-4b5ca800c9a2" released by "delete_volume" :: held 0.783s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:30 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c" returned: 0 in 0.506s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:30 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c Sep 09 17:04:30 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Created reservations ['d7b7fe66-d6d1-41c4-9d60-672a97eec228', '6495918f-35cb-466b-b8d3-b6c42d575b17', 'f9cf73bb-7134-4004-bd7e-7221de20ad66', '28e50f0f-3aee-44d1-90ea-7e8eb75cb6df'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:30 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:30 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:30 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7c457ada-9099-4743-ad03-296d98ab8d1c" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-7c457ada-9099-4743-ad03-296d98ab8d1c" released by "delete_volume" :: held 0.953s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created reservations ['33711ba6-832f-409c-9f04-de5e7043b816', '3b0916a6-dd98-4d63-8401-ca0c4c65bbc9', '19add28f-fe71-411e-bdfe-a9e6ee964f1e', '8fed9edb-03e0-4e5c-be0c-041e85aa654a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:30 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:30 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Deleted volume successfully. Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9bac05f3-ba3e-411d-bad6-66a7639f2cf4 tempest-VolumeAndVolumeTypeFromImageTest-691794017 None] Lock "cinder-29f7510d-045f-4bf8-ad26-4b5ca800c9a2-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:31 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:31 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:31 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.323s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:31 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Deleted volume successfully. Sep 09 17:04:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-7be8aeb3-e417-462f-be87-5f98dea65b0e tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-7c457ada-9099-4743-ad03-296d98ab8d1c-delete_volume" released by "delete_volume" :: held 1.614s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-1b0f0bfe-5238-4f32-9b15-e7351a49086f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-1b0f0bfe-5238-4f32-9b15-e7351a49086f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-quobyte-1b0f0bfe-5238-4f32-9b15-e7351a49086f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-1b0f0bfe-5238-4f32-9b15-e7351a49086f" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4478c4ce-1c7f-4008-b662-1a40137c6530]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:32 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f Sep 09 17:04:32 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:32 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:32 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f Sep 09 17:04:32 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:32 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1b0f0bfe-5238-4f32-9b15-e7351a49086f" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-1b0f0bfe-5238-4f32-9b15-e7351a49086f" released by "delete_volume" :: held 0.828s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created reservations ['2d4b36cd-88b9-4b91-96cd-c2f22a219d7a', '49c3ce83-c749-42f8-a37e-f70381dd41a6', '452932fd-bc9b-4e1d-8a18-1d38cfdba32b', 'aadec9a9-842a-48cc-89e2-09d4f7c136b3'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:33 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:33 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-1125957d-bb63-4322-977b-e68b2f354032-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-1125957d-bb63-4322-977b-e68b2f354032-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-quobyte-1125957d-bb63-4322-977b-e68b2f354032" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-1125957d-bb63-4322-977b-e68b2f354032" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[759d57be-a82a-4009-b8dc-a0aa9ef87e84]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:33 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.424s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Deleted volume successfully. Sep 09 17:04:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a140dd6a-4977-44a4-bde3-ad8b099bad43 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-1b0f0bfe-5238-4f32-9b15-e7351a49086f-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:33 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032 Sep 09 17:04:33 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:34 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032" returned: 0 in 0.636s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:34 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032 Sep 09 17:04:34 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:34 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-1125957d-bb63-4322-977b-e68b2f354032" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-1125957d-bb63-4322-977b-e68b2f354032" released by "delete_volume" :: held 1.046s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created reservations ['310d5005-b78e-460c-94eb-7eea586338b5', '4736cbfc-1b92-43ad-b2ec-cc30ba98d327', '4dc43114-b367-4086-a5e5-1375a4f2c3d8', '5681d5a7-9da0-4575-a297-15750d2071f0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:34 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:34 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Flow 'volume_create_manager' (b4eec97e-83c8-4f78-965f-b0ed1b92f265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dff4cb-4230-49a2-b71f-b0d28f3cd247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7dff4cb-4230-49a2-b71f-b0d28f3cd247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-511193877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41de0fde-c162-41b9-93be-8f26c921ee93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69032840997d42f18b8fa35dfa5dc326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:35Z,use_quota=True,user_id='ac43c481558b4d24bb62539f36640285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8e9932-73aa-4fcb-b21c-ca48a18f3ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8e9932-73aa-4fcb-b21c-ca48a18f3ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49eed6a-db9b-474a-9f37-6e90fb9bca13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d49eed6a-db9b-474a-9f37-6e90fb9bca13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41de0fde-c162-41b9-93be-8f26c921ee93', 'volume_name': 'volume-41de0fde-c162-41b9-93be-8f26c921ee93', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddc5abb-8002-45f6-a851-db2d8c1963b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddc5abb-8002-45f6-a851-db2d8c1963b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4f42f5-9c4d-4c5d-8023-c07dab562646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:34 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Volume 41de0fde-c162-41b9-93be-8f26c921ee93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41de0fde-c162-41b9-93be-8f26c921ee93', 'volume_size': 1} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-511193877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41de0fde-c162-41b9-93be-8f26c921ee93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69032840997d42f18b8fa35dfa5dc326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:35Z,use_quota=True,user_id='ac43c481558b4d24bb62539f36640285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Creating volume 41de0fde-c162-41b9-93be-8f26c921ee93 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:34 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:34 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 1073741824 Sep 09 17:04:34 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:34 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Deleted volume successfully. Sep 09 17:04:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3f7545f1-9b64-4d94-abbf-1ccd19e3b2f0 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-1125957d-bb63-4322-977b-e68b2f354032-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:35 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 1073741824" returned: 0 in 0.562s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:35 devstack sudo[107559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 Sep 09 17:04:35 devstack sudo[107559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-6f02427d-c1c6-4b08-b4d9-367e85440096-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-6f02427d-c1c6-4b08-b4d9-367e85440096-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-quobyte-6f02427d-c1c6-4b08-b4d9-367e85440096" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-6f02427d-c1c6-4b08-b4d9-367e85440096" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe9b8bf-8e16-493d-a921-25911937ee9f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:35 devstack sudo[107559]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93" returned: 0 in 0.371s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d4f42f5-9c4d-4c5d-8023-c07dab562646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41de0fde-c162-41b9-93be-8f26c921ee93', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15df559-ca33-46b0-98a5-22babd99ee50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Volume volume-41de0fde-c162-41b9-93be-8f26c921ee93 (41de0fde-c162-41b9-93be-8f26c921ee93): created successfully Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d15df559-ca33-46b0-98a5-22babd99ee50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Flow 'volume_create_manager' (b4eec97e-83c8-4f78-965f-b0ed1b92f265) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1fde704c-e7e5-40f3-a6c7-8951badd7eaf tempest-VolumeDependencyTests-402217376 None] Created volume successfully. Sep 09 17:04:35 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096 Sep 09 17:04:35 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:36 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:36 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096 Sep 09 17:04:36 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:36 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6f02427d-c1c6-4b08-b4d9-367e85440096" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-6f02427d-c1c6-4b08-b4d9-367e85440096" released by "delete_volume" :: held 0.744s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created reservations ['d6c61241-1001-452a-8177-3eae1e135aed', 'c8b0d2dc-662f-405a-9b63-6cbbc4bf39b5', '9dd9f96c-209d-474a-9eb5-bedc6ff42f6d', 'f82e0e0b-75a3-4290-ad8e-f181dcb38804'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:36 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:36 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:36 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.259s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Deleted volume successfully. Sep 09 17:04:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37b573d6-5038-40d8-bce6-2063eb3fbfb7 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-6f02427d-c1c6-4b08-b4d9-367e85440096-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-dea4a89d-e082-46d6-84cc-d672d7f22249-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-dea4a89d-e082-46d6-84cc-d672d7f22249-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-quobyte-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-quobyte-dea4a89d-e082-46d6-84cc-d672d7f22249" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-dea4a89d-e082-46d6-84cc-d672d7f22249" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Deleting offline snapshot dea4a89d-e082-46d6-84cc-d672d7f22249 of volume 8c5b1bb9-f2b2-4726-bcc7-5acc978e362f {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] snapshot_file for this snap is: volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[96331025-91b0-4b8e-8364-c09020aa0c74]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:37 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 Sep 09 17:04:37 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Flow 'volume_create_manager' (5b0c8654-1c95-4c9e-b944-67d58248e64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3010114-80b5-4eb7-bd55-83e63b0a8a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3010114-80b5-4eb7-bd55-83e63b0a8a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-598494018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd011c0-3bd6-4f5e-91b2-e1a75273d32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e015a366e04dcc8a2946e33a6ed953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:37Z,use_quota=True,user_id='2d5f6a7fce2e41308e497cdd3a356280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:37 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5544aadd-ea93-4fa5-8878-36f2b970f094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5544aadd-ea93-4fa5-8878-36f2b970f094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d86577-16dd-4c71-905d-d2941f0e6310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75d86577-16dd-4c71-905d-d2941f0e6310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd011c0-3bd6-4f5e-91b2-e1a75273d32f', 'volume_name': 'volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fae636-3545-4a72-8cbc-f2c4e05bcdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30fae636-3545-4a72-8cbc-f2c4e05bcdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dd7adc-f31d-44ed-93e7-e54c2d38b406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Volume 6bd011c0-3bd6-4f5e-91b2-e1a75273d32f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f', 'volume_size': 1} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-598494018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd011c0-3bd6-4f5e-91b2-e1a75273d32f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e015a366e04dcc8a2946e33a6ed953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:37Z,use_quota=True,user_id='2d5f6a7fce2e41308e497cdd3a356280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Creating volume 6bd011c0-3bd6-4f5e-91b2-e1a75273d32f {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:37 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249" returned: 0 in 0.636s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:04:37 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f 1073741824 Sep 09 17:04:37 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[93baa819-873a-4221-858a-2deae23c46d7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:38 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f Sep 09 17:04:38 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (442e26aa-8dcb-4b11-ac1e-19cfe67b7494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f698070-9960-4455-91c1-63f7d1b2be09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f698070-9960-4455-91c1-63f7d1b2be09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477526527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b91917b-1c55-44ae-843f-8192c1420694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:38Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d1d6fe-d60a-4a4c-b395-99512b8bf01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83d1d6fe-d60a-4a4c-b395-99512b8bf01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e80f2e8-c027-493f-b6ce-8b42a586d4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e80f2e8-c027-493f-b6ce-8b42a586d4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b91917b-1c55-44ae-843f-8192c1420694', 'volume_name': 'volume-9b91917b-1c55-44ae-843f-8192c1420694', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446eb8b8-514e-485c-be1e-e7735a9640c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (446eb8b8-514e-485c-be1e-e7735a9640c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08257383-366a-42d4-9eb4-4575505a1b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Volume 9b91917b-1c55-44ae-843f-8192c1420694: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b91917b-1c55-44ae-843f-8192c1420694', 'volume_size': 1} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Flow 'volume_create_manager' (e9ef57dc-e594-49df-aaeb-8661ee561738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e41cf5-d74d-46e6-b156-a779bfe09c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91e41cf5-d74d-46e6-b156-a779bfe09c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-281045934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c09aced-c190-4903-b8f8-f3514455ea36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e015a366e04dcc8a2946e33a6ed953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:38Z,use_quota=True,user_id='2d5f6a7fce2e41308e497cdd3a356280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca9b310-c198-49d2-9fe2-fcb5607dd54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ca9b310-c198-49d2-9fe2-fcb5607dd54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2b4da2-be92-41e5-8754-c9653f709839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb2b4da2-be92-41e5-8754-c9653f709839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c09aced-c190-4903-b8f8-f3514455ea36', 'volume_name': 'volume-6c09aced-c190-4903-b8f8-f3514455ea36', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c28d23-e276-4fec-af3f-84abd75ec731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64c28d23-e276-4fec-af3f-84abd75ec731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87399e6-637d-4887-9285-0029e7f3e7d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Volume 6c09aced-c190-4903-b8f8-f3514455ea36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c09aced-c190-4903-b8f8-f3514455ea36', 'volume_size': 1} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:38 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Flow 'volume_create_manager' (9974995f-6b11-4252-9259-735a86ccd7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0d5483-b07f-4afe-a8e6-1c574671ef11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f 1073741824" returned: 0 in 0.699s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" returned: 0 in 0.622s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:38 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 Sep 09 17:04:38 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a0d5483-b07f-4afe-a8e6-1c574671ef11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433658839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2591808-6e38-4995-b23e-b01077d9b9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e015a366e04dcc8a2946e33a6ed953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:38Z,use_quota=True,user_id='2d5f6a7fce2e41308e497cdd3a356280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b950b531-394a-411f-ae91-a8ab49c88afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b950b531-394a-411f-ae91-a8ab49c88afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3764f24b-9ccc-412d-b989-0a4b134671f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3764f24b-9ccc-412d-b989-0a4b134671f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2591808-6e38-4995-b23e-b01077d9b9af', 'volume_name': 'volume-d2591808-6e38-4995-b23e-b01077d9b9af', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfa57e7-70ce-4430-85f4-cdc73228a2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cfa57e7-70ce-4430-85f4-cdc73228a2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02c99c8-2fd0-4f70-867a-c3e05280f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Volume d2591808-6e38-4995-b23e-b01077d9b9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2591808-6e38-4995-b23e-b01077d9b9af', 'volume_size': 1} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:38 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f Sep 09 17:04:38 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Flow 'volume_create_manager' (27e7fb17-67fd-4915-918e-0154cd1ba39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ba25b4-4d5c-434b-ac47-f57472cbb926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44ba25b4-4d5c-434b-ac47-f57472cbb926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-583094143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31388e07-8249-4420-bfa0-b04e6118e949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e015a366e04dcc8a2946e33a6ed953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:39Z,use_quota=True,user_id='2d5f6a7fce2e41308e497cdd3a356280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85a5cd0-cfa0-4e44-a4fd-d88d40da5c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85a5cd0-cfa0-4e44-a4fd-d88d40da5c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afc5c49-ca54-4b76-9c2d-76b4ed9305d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afc5c49-ca54-4b76-9c2d-76b4ed9305d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31388e07-8249-4420-bfa0-b04e6118e949', 'volume_name': 'volume-31388e07-8249-4420-bfa0-b04e6118e949', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c34f94-b8b4-41e1-aad9-1ab8437df869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2c34f94-b8b4-41e1-aad9-1ab8437df869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef6de1e-fb43-49f7-8419-f7c933434622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:38 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Volume 31388e07-8249-4420-bfa0-b04e6118e949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31388e07-8249-4420-bfa0-b04e6118e949', 'volume_size': 1} Sep 09 17:04:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:39 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249" returned: 0 in 0.427s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:39 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249 Sep 09 17:04:39 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:39 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.142s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74dd7adc-f31d-44ed-93e7-e54c2d38b406) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc0c6c9-add1-4ef0-8522-7c24c2c3b50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Creating offline snapshot edf330e1-73e8-4cf8-b1fc-753f76aa131b of volume 41de0fde-c162-41b9-93be-8f26c921ee93 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:04:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Volume volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f (6bd011c0-3bd6-4f5e-91b2-e1a75273d32f): created successfully Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffc0c6c9-add1-4ef0-8522-7c24c2c3b50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Flow 'volume_create_manager' (5b0c8654-1c95-4c9e-b944-67d58248e64a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76577ce-915c-4872-965f-792560d2d135]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Flow 'volume_create_manager' (8c63e187-6bac-4988-b6a5-679f82082250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4624681-cbe4-43a7-b4af-47ad80034f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-86afc257-7b92-4629-a5f8-ef96848da2a3 tempest-CreateVolumesFromImageTest-68781591 None] Created volume successfully. Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4624681-cbe4-43a7-b4af-47ad80034f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1471393402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7acef885-0f5a-4db4-bc98-0aed26b930b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e015a366e04dcc8a2946e33a6ed953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:39Z,use_quota=True,user_id='2d5f6a7fce2e41308e497cdd3a356280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559622ee-3726-44a6-a5a4-dfa24a994711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (559622ee-3726-44a6-a5a4-dfa24a994711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0c7e9e-c71e-49c1-9cb6-84e555b656cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0c7e9e-c71e-49c1-9cb6-84e555b656cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7acef885-0f5a-4db4-bc98-0aed26b930b8', 'volume_name': 'volume-7acef885-0f5a-4db4-bc98-0aed26b930b8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64675e08-ec43-4b17-9df3-eaa2fedcb84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64675e08-ec43-4b17-9df3-eaa2fedcb84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:39 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194fcefd-4fd5-4977-a391-43aa28e8942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:39 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:39 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Volume 7acef885-0f5a-4db4-bc98-0aed26b930b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7acef885-0f5a-4db4-bc98-0aed26b930b8', 'volume_size': 1} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:39 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f.dea4a89d-e082-46d6-84cc-d672d7f22249" returned: 0 in 0.284s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-dea4a89d-e082-46d6-84cc-d672d7f22249" released by "_delete_snapshot" :: held 2.096s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" released by "delete_snapshot" :: held 2.128s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created reservations ['fbf3b71b-f58b-43ea-be32-9fa267b1ebda', 'e563db51-0497-4a4e-bad4-9433124219a7', 'f5d34c3a-05dd-46e7-8221-3f559ab862a3', '8a59f108-83a3-4891-ade3-6a85be43d9ed'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Delete snapshot completed successfully. Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-966e2412-1914-41bb-be07-b8ec0685a654 tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-dea4a89d-e082-46d6-84cc-d672d7f22249-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:39 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:39 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b 1G Sep 09 17:04:39 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "cinder-quobyte-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5aac89-2a79-4b81-b490-f9ea48b7f88c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:39 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f Sep 09 17:04:39 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:39 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b 1G" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41de0fde-c162-41b9-93be-8f26c921ee93 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:40 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41de0fde-c162-41b9-93be-8f26c921ee93 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b Sep 09 17:04:40 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:40 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:40 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f Sep 09 17:04:40 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:40 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41de0fde-c162-41b9-93be-8f26c921ee93 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:40 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b is being set with open permissions: ugo+rw Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:40 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b Sep 09 17:04:40 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:40 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-quobyte-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f" released by "delete_volume" :: held 0.710s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Created reservations ['b45f2f9f-1279-4283-ab56-bc810a3c82ef', '89d3386e-14b2-4ee3-af29-321db8aaf534', 'c83896a4-8cef-4f2a-a458-6022aaff651d', '11c56a4c-6611-4fa5-b22a-f5e340ae561b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:40 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:40 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:40 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:40 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.info Sep 09 17:04:40 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:40 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Deleted volume successfully. Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-37a8f22f-e389-4571-9f7a-9ff136e7431c tempest-CreateVolumesFromSnapshotTest-1561026492 None] Lock "cinder-8c5b1bb9-f2b2-4726-bcc7-5acc978e362f-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:40 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.info" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:40 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.info is being set with open permissions: ugo+rw Sep 09 17:04:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:40 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.info Sep 09 17:04:40 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:41 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.info" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.844s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1477526527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b91917b-1c55-44ae-843f-8192c1420694,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:38Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Creating volume 9b91917b-1c55-44ae-843f-8192c1420694 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:41 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:41 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 1073741824 Sep 09 17:04:41 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0f3514fd-6fb2-4908-a71a-9419ad7ab377 tempest-VolumeDependencyTests-402217376 None] Create snapshot completed successfully Sep 09 17:04:41 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 1073741824" returned: 0 in 0.474s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:41 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 Sep 09 17:04:41 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:41 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694" returned: 0 in 0.275s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.436s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-281045934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c09aced-c190-4903-b8f8-f3514455ea36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e015a366e04dcc8a2946e33a6ed953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:38Z,use_quota=True,user_id='2d5f6a7fce2e41308e497cdd3a356280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Creating volume 6c09aced-c190-4903-b8f8-f3514455ea36 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:42 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08257383-366a-42d4-9eb4-4575505a1b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b91917b-1c55-44ae-843f-8192c1420694', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:42 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36 1073741824 Sep 09 17:04:42 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d0ebfd-9df9-42d4-9128-7a28f6e2d3ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Volume volume-9b91917b-1c55-44ae-843f-8192c1420694 (9b91917b-1c55-44ae-843f-8192c1420694): created successfully Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9d0ebfd-9df9-42d4-9128-7a28f6e2d3ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (442e26aa-8dcb-4b11-ac1e-19cfe67b7494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-bc2e6a4d-c377-4423-8b0c-2e8777d34804 tempest-ProjectMemberTests-1056521081 None] Created volume successfully. Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:42 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36 1073741824" returned: 0 in 0.508s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Flow 'volume_create_manager' (2cb935ae-459d-4966-b75a-8a0e5c51f63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed77a1e8-26bd-4d5a-a3cf-2a5bd3ff2b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed77a1e8-26bd-4d5a-a3cf-2a5bd3ff2b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-875351261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69032840997d42f18b8fa35dfa5dc326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=edf330e1-73e8-4cf8-b1fc-753f76aa131b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:42Z,use_quota=True,user_id='ac43c481558b4d24bb62539f36640285',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52938972-a0c4-47ab-b3ae-4efecf07374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52938972-a0c4-47ab-b3ae-4efecf07374f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acbbf256-b391-42c1-86a5-54fe63b26efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acbbf256-b391-42c1-86a5-54fe63b26efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8', 'volume_name': 'volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8', 'volume_size': 1, 'snapshot_id': 'edf330e1-73e8-4cf8-b1fc-753f76aa131b'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b389aeaa-a291-461d-acf9-a24ee3b592bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b389aeaa-a291-461d-acf9-a24ee3b592bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a397b0-fc19-4b03-94da-9be8518f3e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Volume 2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8', 'volume_size': 1, 'snapshot_id': 'edf330e1-73e8-4cf8-b1fc-753f76aa131b'} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:42 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36 Sep 09 17:04:42 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:42 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.905s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.171s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-433658839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2591808-6e38-4995-b23e-b01077d9b9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e015a366e04dcc8a2946e33a6ed953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:38Z,use_quota=True,user_id='2d5f6a7fce2e41308e497cdd3a356280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Creating volume d2591808-6e38-4995-b23e-b01077d9b9af {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:42 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e87399e6-637d-4887-9285-0029e7f3e7d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c09aced-c190-4903-b8f8-f3514455ea36', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545fe605-5409-4916-8914-c44d1d7402f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:42 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af 1073741824 Sep 09 17:04:42 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:42 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Volume volume-6c09aced-c190-4903-b8f8-f3514455ea36 (6c09aced-c190-4903-b8f8-f3514455ea36): created successfully Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (545fe605-5409-4916-8914-c44d1d7402f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:42 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Flow 'volume_create_manager' (e9ef57dc-e594-49df-aaeb-8661ee561738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-54ed9d58-e011-4cf8-a667-397409713d77 tempest-CreateVolumesFromImageTest-68781591 None] Created volume successfully. Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:43 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af 1073741824" returned: 0 in 0.526s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:43 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af Sep 09 17:04:43 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:43 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.843s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-583094143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31388e07-8249-4420-bfa0-b04e6118e949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e015a366e04dcc8a2946e33a6ed953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:39Z,use_quota=True,user_id='2d5f6a7fce2e41308e497cdd3a356280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Creating volume 31388e07-8249-4420-bfa0-b04e6118e949 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:43 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:43 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949 1073741824 Sep 09 17:04:43 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02c99c8-2fd0-4f70-867a-c3e05280f021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2591808-6e38-4995-b23e-b01077d9b9af', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c64c28-113d-4925-9801-15a0e1986eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:43 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Volume volume-d2591808-6e38-4995-b23e-b01077d9b9af (d2591808-6e38-4995-b23e-b01077d9b9af): created successfully Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36c64c28-113d-4925-9801-15a0e1986eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Flow 'volume_create_manager' (9974995f-6b11-4252-9259-735a86ccd7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-38f6c09b-d6f6-4da5-8713-f622452b6bd4 tempest-CreateVolumesFromImageTest-68781591 None] Created volume successfully. Sep 09 17:04:44 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949 1073741824" returned: 0 in 0.432s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:44 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949 Sep 09 17:04:44 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:44 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.175s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1471393402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7acef885-0f5a-4db4-bc98-0aed26b930b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67e015a366e04dcc8a2946e33a6ed953',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:39Z,use_quota=True,user_id='2d5f6a7fce2e41308e497cdd3a356280',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Creating volume 7acef885-0f5a-4db4-bc98-0aed26b930b8 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:44 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef6de1e-fb43-49f7-8419-f7c933434622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31388e07-8249-4420-bfa0-b04e6118e949', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:44 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8 1073741824 Sep 09 17:04:44 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce04257-a3d7-49b0-b613-a2c89d282b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Volume volume-31388e07-8249-4420-bfa0-b04e6118e949 (31388e07-8249-4420-bfa0-b04e6118e949): created successfully Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ce04257-a3d7-49b0-b613-a2c89d282b81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Flow 'volume_create_manager' (27e7fb17-67fd-4915-918e-0154cd1ba39e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0e1b4c13-787c-4486-a3ce-aea8acf10fcf tempest-CreateVolumesFromImageTest-68781591 None] Created volume successfully. Sep 09 17:04:44 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8 1073741824" returned: 0 in 0.413s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:44 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8 Sep 09 17:04:44 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:45 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.538s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Acquiring lock "cinder-quobyte-edf330e1-73e8-4cf8-b1fc-753f76aa131b-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:45 devstack sudo[107696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:45 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (194fcefd-4fd5-4977-a391-43aa28e8942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7acef885-0f5a-4db4-bc98-0aed26b930b8', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f71246a-6dcf-4e8f-8c84-c9c312753eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-edf330e1-73e8-4cf8-b1fc-753f76aa131b-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Creating volume 2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 from snapshot edf330e1-73e8-4cf8-b1fc-753f76aa131b {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Acquiring lock "cinder-quobyte-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:45 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Volume volume-7acef885-0f5a-4db4-bc98-0aed26b930b8 (7acef885-0f5a-4db4-bc98-0aed26b930b8): created successfully Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f71246a-6dcf-4e8f-8c84-c9c312753eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Flow 'volume_create_manager' (8c63e187-6bac-4988-b6a5-679f82082250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] snapshot: edf330e1-73e8-4cf8-b1fc-753f76aa131b, volume: 2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:04:45 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f71e9f7d-3736-4b51-a404-2b535e25ee89 tempest-CreateVolumesFromImageTest-68781591 None] Created volume successfully. Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10b6355-8de4-43c5-8477-0d8a337740fb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:45 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:04:45 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b Sep 09 17:04:45 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:45 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b" returned: 0 in 0.398s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41de0fde-c162-41b9-93be-8f26c921ee93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[237c8c9a-297e-48ac-911e-01b1825df570]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:45 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 Sep 09 17:04:45 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:45 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "cinder-7acef885-0f5a-4db4-bc98-0aed26b930b8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-7acef885-0f5a-4db4-bc98-0aed26b930b8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "cinder-quobyte-7acef885-0f5a-4db4-bc98-0aed26b930b8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-quobyte-7acef885-0f5a-4db4-bc98-0aed26b930b8" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3e2a98-2bc3-40e3-bd70-25eff1b8b730]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:46 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93" returned: 0 in 0.423s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:46 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 Sep 09 17:04:46 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:46 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8 Sep 09 17:04:46 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:46 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:46 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8 Sep 09 17:04:46 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:46 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7acef885-0f5a-4db4-bc98-0aed26b930b8" returned: 0 in 0.306s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-quobyte-7acef885-0f5a-4db4-bc98-0aed26b930b8" released by "delete_volume" :: held 0.721s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Created reservations ['bc4bb420-dbc2-47d0-862a-75c8b7b716ec', '72eb2380-96d5-4014-a597-3925d49e2b22', '89c24598-a65f-4324-989b-da7ff4cfba65', '20ca6e09-5b89-43ea-a845-29952c96c5e7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:47 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:47 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "cinder-31388e07-8249-4420-bfa0-b04e6118e949-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-31388e07-8249-4420-bfa0-b04e6118e949-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "cinder-quobyte-31388e07-8249-4420-bfa0-b04e6118e949" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-quobyte-31388e07-8249-4420-bfa0-b04e6118e949" acquired by "delete_volume" :: waited 0.047s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:47 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.517s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:47 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:47 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Deleted volume successfully. Sep 09 17:04:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1456b02a-9d81-40ff-9d05-2411afe58162]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:47 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-be55b953-3d6b-4aa0-b1e1-26b65397d1a4 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-7acef885-0f5a-4db4-bc98-0aed26b930b8-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:47 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949 Sep 09 17:04:47 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:48 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949" returned: 0 in 0.826s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:48 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949 Sep 09 17:04:48 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:49 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-31388e07-8249-4420-bfa0-b04e6118e949" returned: 0 in 0.673s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-quobyte-31388e07-8249-4420-bfa0-b04e6118e949" released by "delete_volume" :: held 1.649s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Created reservations ['3b09096b-95ab-4c32-865b-12ce214b49dd', '6b64469f-1e53-4568-becc-4055f5d533e8', '9983a0a9-f548-4cfd-acbb-67509eb01ed3', '22090861-3f7b-4d4a-9fb7-8e1a6c7ca997'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:49 devstack sudo[107743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:49 devstack sudo[107743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "cinder-d2591808-6e38-4995-b23e-b01077d9b9af-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-d2591808-6e38-4995-b23e-b01077d9b9af-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "cinder-quobyte-d2591808-6e38-4995-b23e-b01077d9b9af" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:50 devstack sudo[107743]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.618s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:50 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Deleted volume successfully. Sep 09 17:04:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-quobyte-d2591808-6e38-4995-b23e-b01077d9b9af" acquired by "delete_volume" :: waited 0.048s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-412179a7-14aa-4e0f-a76d-ccbeea8fe606 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-31388e07-8249-4420-bfa0-b04e6118e949-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:50 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2315745-fc98-4260-a622-ce92e41f6758]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:50 devstack sudo[107747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af Sep 09 17:04:50 devstack sudo[107747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:50 devstack sudo[107747]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af" returned: 0 in 0.826s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:51 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af Sep 09 17:04:51 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:51 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d2591808-6e38-4995-b23e-b01077d9b9af" returned: 0 in 0.452s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-quobyte-d2591808-6e38-4995-b23e-b01077d9b9af" released by "delete_volume" :: held 1.383s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Created reservations ['b51a2921-698d-49c0-b88b-1cc16b90b1a2', 'b8e04f86-f1f0-4cc2-b48b-22999c080e56', '8075657f-63d1-4469-9d69-754fbeee4512', 'a5648753-4926-4bcd-ab2b-1935c3941c3b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:51 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:51 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:51 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" returned: 0 in 5.672s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:04:51 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Converted 1024.00 MB image at 180.50 MB/s Sep 09 17:04:51 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 is being set with open permissions: ugo+rw Sep 09 17:04:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:51 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 Sep 09 17:04:51 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:52 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.305s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Deleted volume successfully. Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d0a73480-59d3-4843-810d-5e9fabb84f8e tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-d2591808-6e38-4995-b23e-b01077d9b9af-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:52 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" returned: 0 in 0.270s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" released by "_copy_volume_from_snapshot" :: held 6.861s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-edf330e1-73e8-4cf8-b1fc-753f76aa131b-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" released by "_create_volume_from_snapshot" :: held 6.957s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.997s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.931s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Creating offline snapshot 75447d44-e2b4-4d11-93b1-5e30e2b57843 of volume 9b91917b-1c55-44ae-843f-8192c1420694 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43a397b0-fc19-4b03-94da-9be8518f3e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8', 'volume_size': 1, 'snapshot_id': 'edf330e1-73e8-4cf8-b1fc-753f76aa131b'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bd58e4-3792-43cc-ab4d-467915f54dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6111c8a7-6570-4322-ba7d-77c4e46de6e2]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:52 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Volume volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 (2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8): created successfully Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59bd58e4-3792-43cc-ab4d-467915f54dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Flow 'volume_create_manager' (2cb935ae-459d-4966-b75a-8a0e5c51f63f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "cinder-6c09aced-c190-4903-b8f8-f3514455ea36-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-6c09aced-c190-4903-b8f8-f3514455ea36-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:52 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0f5bcb42-6c0e-4f06-a50c-cf55882f0199 tempest-VolumeDependencyTests-402217376 None] Created volume successfully. Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "cinder-quobyte-6c09aced-c190-4903-b8f8-f3514455ea36" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:52 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 Sep 09 17:04:52 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-quobyte-6c09aced-c190-4903-b8f8-f3514455ea36" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[da329160-9c31-4a90-9e5f-413a9277ff67]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:52 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36 Sep 09 17:04:52 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:52 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694" returned: 0 in 0.443s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:52 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 1G Sep 09 17:04:52 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:52 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:52 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36 Sep 09 17:04:52 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:53 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6c09aced-c190-4903-b8f8-f3514455ea36" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:53 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 1G" returned: 0 in 0.453s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b91917b-1c55-44ae-843f-8192c1420694 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-quobyte-6c09aced-c190-4903-b8f8-f3514455ea36" released by "delete_volume" :: held 0.752s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:53 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b91917b-1c55-44ae-843f-8192c1420694 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 Sep 09 17:04:53 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Created reservations ['11d3bc25-5349-45a7-9dfa-fc08552f70cd', '9df4f845-cfaa-4765-9c05-9ff5859ff554', '47f58c51-6e9a-4631-89c5-06485b3bff18', '15d0cae7-7465-4d3b-ad93-389df9171cbb'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Acquiring lock "cinder-edf330e1-73e8-4cf8-b1fc-753f76aa131b-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Lock "cinder-edf330e1-73e8-4cf8-b1fc-753f76aa131b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Acquiring lock "cinder-quobyte-41de0fde-c162-41b9-93be-8f26c921ee93" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-41de0fde-c162-41b9-93be-8f26c921ee93" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Acquiring lock "cinder-quobyte-edf330e1-73e8-4cf8-b1fc-753f76aa131b" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-edf330e1-73e8-4cf8-b1fc-753f76aa131b" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Deleting offline snapshot edf330e1-73e8-4cf8-b1fc-753f76aa131b of volume 41de0fde-c162-41b9-93be-8f26c921ee93 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:04:53 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:53 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] snapshot_file for this snap is: volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f00de8-a127-441d-a605-5688a260cf7d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "cinder-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:53 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b91917b-1c55-44ae-843f-8192c1420694 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:53 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 is being set with open permissions: ugo+rw Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:53 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b Sep 09 17:04:53 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:53 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 Sep 09 17:04:53 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "cinder-quobyte-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-quobyte-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f" acquired by "delete_volume" :: waited 0.029s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[9012df0d-515c-4205-aa8d-2298665db3a7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:53 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.392s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Deleted volume successfully. Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-a16609da-156f-4af7-a1df-2179f8c17071 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-6c09aced-c190-4903-b8f8-f3514455ea36-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:53 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f Sep 09 17:04:53 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:53 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b" returned: 0 in 0.474s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41de0fde-c162-41b9-93be-8f26c921ee93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9f7223-1f1b-48e5-b764-546dbdd369c6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:53 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843" returned: 0 in 0.384s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:54 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.info Sep 09 17:04:54 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:54 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 Sep 09 17:04:54 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:54 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f" returned: 0 in 0.468s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:54 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f Sep 09 17:04:54 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:54 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.info" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:54 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.info is being set with open permissions: ugo+rw Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:54 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.info Sep 09 17:04:54 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:54 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f" returned: 0 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-quobyte-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f" released by "delete_volume" :: held 0.846s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:54 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93" returned: 0 in 0.629s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:54 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.info" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:54 devstack sudo[107820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b Sep 09 17:04:54 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.429s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Created reservations ['42ce6627-b3c9-4d83-9266-68089969264b', '17f1c2b9-cd63-4b1a-b71e-575c0de586a8', 'fb677760-20a2-4f67-8939-4a3b34ca346a', 'c367d73d-0cf9-477d-a762-2ff04c66e503'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:54 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e332fad0-efd0-4a2d-9cfa-0b230ac2c64c tempest-ProjectMemberTests-1056521081 None] Create snapshot completed successfully Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:54 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:54 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:54 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:55 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b Sep 09 17:04:55 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:55 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-75447d44-e2b4-4d11-93b1-5e30e2b57843-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.301s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Deleted volume successfully. Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-75447d44-e2b4-4d11-93b1-5e30e2b57843-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-9b91917b-1c55-44ae-843f-8192c1420694" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3abfa320-fb54-4893-a3f0-95e3a1438035 tempest-CreateVolumesFromImageTest-68781591 None] Lock "cinder-6bd011c0-3bd6-4f5e-91b2-e1a75273d32f-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-9b91917b-1c55-44ae-843f-8192c1420694" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-75447d44-e2b4-4d11-93b1-5e30e2b57843" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-75447d44-e2b4-4d11-93b1-5e30e2b57843" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Deleting offline snapshot 75447d44-e2b4-4d11-93b1-5e30e2b57843 of volume 9b91917b-1c55-44ae-843f-8192c1420694 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] snapshot_file for this snap is: volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[721d5e27-c4fa-4709-b655-a4875c0df93a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:55 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 Sep 09 17:04:55 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:55 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93.edf330e1-73e8-4cf8-b1fc-753f76aa131b" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-edf330e1-73e8-4cf8-b1fc-753f76aa131b" released by "_delete_snapshot" :: held 1.923s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-41de0fde-c162-41b9-93be-8f26c921ee93" released by "delete_snapshot" :: held 1.992s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Created reservations ['1533f585-b050-46dc-971a-9c9f993d175d', 'cdedac7b-ccdc-4858-bdd6-1d1d21726ee4', '0e58fb14-0fc1-4229-86d9-3130c5b849c8', 'eb9a389e-c6aa-42f1-895e-9ce4908779ff'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Delete snapshot completed successfully. Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-157e0a3c-a420-43df-89ec-8276f285dc41 tempest-VolumeDependencyTests-402217376 None] Lock "cinder-edf330e1-73e8-4cf8-b1fc-753f76aa131b-delete_snapshot" released by "delete_snapshot" :: held 2.225s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:55 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b91917b-1c55-44ae-843f-8192c1420694(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c91e8c4-302f-4cd3-8dff-c9b5b2f20942]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Flow 'volume_create_manager' (6127219d-ebd9-4822-a2b9-db64d357af66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c2e98f-1d7c-490a-8694-1c02de5f5bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c2e98f-1d7c-490a-8694-1c02de5f5bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1791048823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b5204519494ca1906af4d7be979dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:56Z,use_quota=True,user_id='2437268613e941d69d59ba1865b941a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:55 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 Sep 09 17:04:55 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8c712a-f530-43de-882d-b53bfdc26fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8c712a-f530-43de-882d-b53bfdc26fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a79d1a0-5f67-4ede-89c1-ea4eba080530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a79d1a0-5f67-4ede-89c1-ea4eba080530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9648ad6-1190-4e6f-9e3f-d3e30bdf06ea', 'volume_name': 'volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8583be2f-f34a-4308-961e-837b0bee157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8583be2f-f34a-4308-961e-837b0bee157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5886d682-d7fd-4655-9334-0a2b8e528c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:55 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Volume d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea', 'volume_size': 1} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1791048823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b5204519494ca1906af4d7be979dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:56Z,use_quota=True,user_id='2437268613e941d69d59ba1865b941a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Creating volume d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:55 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:55 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea 1073741824 Sep 09 17:04:55 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:55 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:56 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 Sep 09 17:04:56 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:56 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea 1073741824" returned: 0 in 0.503s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:56 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea Sep 09 17:04:56 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:56 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843" returned: 0 in 0.399s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:56 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843 Sep 09 17:04:56 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Acquiring lock "cinder-41de0fde-c162-41b9-93be-8f26c921ee93-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Lock "cinder-41de0fde-c162-41b9-93be-8f26c921ee93-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:56 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Acquiring lock "cinder-quobyte-41de0fde-c162-41b9-93be-8f26c921ee93" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5886d682-d7fd-4655-9334-0a2b8e528c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6628f7d9-a099-4baf-8944-1833ec8951d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-41de0fde-c162-41b9-93be-8f26c921ee93" acquired by "delete_volume" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:56 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Volume volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea (d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea): created successfully Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6628f7d9-a099-4baf-8944-1833ec8951d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Flow 'volume_create_manager' (6127219d-ebd9-4822-a2b9-db64d357af66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b70c8f2-5144-4fab-8524-e2940cbd0113]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:56 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694.75447d44-e2b4-4d11-93b1-5e30e2b57843" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c7053a84-5989-4485-915f-8c8fcf2575d7 tempest-ProjectReaderTests-412387478 None] Created volume successfully. Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-75447d44-e2b4-4d11-93b1-5e30e2b57843" released by "_delete_snapshot" :: held 1.716s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-9b91917b-1c55-44ae-843f-8192c1420694" released by "delete_snapshot" :: held 1.743s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Created reservations ['ceaea2dd-9e83-4c29-b8bf-6e8fd7c46460', '40686044-e7d8-4ac4-9056-1ad28cbbb024', '59562d32-d426-44ea-8627-86b4418241df', 'aa0b4bcc-53e5-415a-ae29-d5db87f4aed8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:56 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 Sep 09 17:04:56 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:56 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Delete snapshot completed successfully. Sep 09 17:04:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-36f952f6-913b-470a-bc7d-15eee18afbf4 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-75447d44-e2b4-4d11-93b1-5e30e2b57843-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:57 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93" returned: 0 in 0.416s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:57 devstack sudo[107866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93 Sep 09 17:04:57 devstack sudo[107866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-9b91917b-1c55-44ae-843f-8192c1420694-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Lock "cinder-9b91917b-1c55-44ae-843f-8192c1420694-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-9b91917b-1c55-44ae-843f-8192c1420694" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-9b91917b-1c55-44ae-843f-8192c1420694" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[de10e2b7-4d80-4d94-b9b7-e3bdb61a2d8b]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:57 devstack sudo[107866]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-41de0fde-c162-41b9-93be-8f26c921ee93" returned: 0 in 0.298s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:57 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 Sep 09 17:04:57 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-41de0fde-c162-41b9-93be-8f26c921ee93" released by "delete_volume" :: held 0.811s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Created reservations ['46d000c0-4182-436f-b1c6-1b39126d509f', '68cfc5af-cba0-4388-b807-d9c76f373fc4', 'b3ce34f5-8fd3-4693-a4b6-5210ff3f8d8f', 'fcdfe9ec-f8b4-4369-890c-ef066dc28e51'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:57 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:57 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Acquiring lock "cinder-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:57 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694" returned: 0 in 0.471s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Lock "cinder-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:57 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694 Sep 09 17:04:57 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Acquiring lock "cinder-quobyte-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[df53fb42-c2ac-4592-8adf-fce02de302b4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:58 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Deleted volume successfully. Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f1fe10d3-d80c-4bd2-b067-c29eab8d1bdd tempest-VolumeDependencyTests-402217376 None] Lock "cinder-41de0fde-c162-41b9-93be-8f26c921ee93-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:58 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 Sep 09 17:04:58 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:58 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-9b91917b-1c55-44ae-843f-8192c1420694" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-9b91917b-1c55-44ae-843f-8192c1420694" released by "delete_volume" :: held 0.896s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Acquiring lock "cinder-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Created reservations ['d0dd531c-ec8f-4d8d-b7c5-51fa415f0847', 'a8cc05ae-c975-4836-b701-e4ed248a32ba', '1274c3eb-a529-4feb-8527-6651bccb77cc', 'e7ca106e-374b-4aab-8ee7-a2ded959adc7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Lock "cinder-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Acquiring lock "cinder-quobyte-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Lock "cinder-quobyte-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea" acquired by "delete_volume" :: waited 0.052s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:04:58 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" returned: 0 in 0.510s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:58 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:58 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fd4405-a7c7-4426-89ec-932a69bbcfdc]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:58 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8 Sep 09 17:04:58 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:58 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea Sep 09 17:04:58 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:58 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" returned: 0 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Lock "cinder-quobyte-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8" released by "delete_volume" :: held 0.913s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:58 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.415s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Deleted volume successfully. Sep 09 17:04:58 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-afa7fa74-5879-40f9-bcd7-79ac4edd2bec tempest-ProjectMemberTests-1056521081 None] Lock "cinder-9b91917b-1c55-44ae-843f-8192c1420694-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Created reservations ['cf4b4a29-00bd-4eaa-a186-5acb7ced7e25', '7738a24c-4ea5-4a4f-a79d-e201d3b9a539', '1023d45e-029e-4ce9-babf-032cad52d92a', '4c5e5d6f-4c82-4417-b068-71e10e50920f'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:59 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea" returned: 0 in 0.546s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:59 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea Sep 09 17:04:59 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:59 devstack sudo[107899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:59 devstack sudo[107899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (6002c1d7-370b-4027-8fb9-611fee62fc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e73abc0-9d5f-4d6e-bc02-ff1896aa0f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e73abc0-9d5f-4d6e-bc02-ff1896aa0f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370954416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac947d3-c2f6-43d3-96bf-a0849c11024b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:59Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d05fba9-eebb-4c3e-b542-55e353b9e169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d05fba9-eebb-4c3e-b542-55e353b9e169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65a000e-ccda-4b2f-9c53-5ed398736e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65a000e-ccda-4b2f-9c53-5ed398736e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac947d3-c2f6-43d3-96bf-a0849c11024b', 'volume_name': 'volume-cac947d3-c2f6-43d3-96bf-a0849c11024b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5895c8f4-e7ab-4f11-bea9-663ab2851c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5895c8f4-e7ab-4f11-bea9-663ab2851c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e02bc5-72ed-45b6-8d98-f5e7cf635fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:04:59 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Volume cac947d3-c2f6-43d3-96bf-a0849c11024b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac947d3-c2f6-43d3-96bf-a0849c11024b', 'volume_size': 1} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:04:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-370954416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cac947d3-c2f6-43d3-96bf-a0849c11024b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:04:59Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Creating volume cac947d3-c2f6-43d3-96bf-a0849c11024b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:04:59 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:59 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b 1073741824 Sep 09 17:04:59 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:59 devstack sudo[107899]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.302s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:59 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Deleted volume successfully. Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea" returned: 0 in 0.366s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Lock "cinder-quobyte-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea" released by "delete_volume" :: held 0.986s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-0bcba731-e20f-47e5-94b4-a8df2e5f314d tempest-VolumeDependencyTests-402217376 None] Lock "cinder-2d34db78-cf9a-4d1f-8f9d-891e7d0fe9c8-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Created reservations ['e12f6114-fc31-4bc6-b4d6-31768dabb959', 'efa882ff-ad00-4b6e-a203-d3057f9bbce3', '1713403f-878a-4c31-b193-2f041d30df1f', '389381f9-03ce-4c73-ad95-5ca46b18dda0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:59 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:04:59 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:59 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b 1073741824" returned: 0 in 0.526s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:04:59 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b Sep 09 17:04:59 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:04:59 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.292s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:04:59 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Deleted volume successfully. Sep 09 17:04:59 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78868e39-4d99-4925-8ac0-d87ec9def595 tempest-ProjectReaderTests-412387478 None] Lock "cinder-d9648ad6-1190-4e6f-9e3f-d3e30bdf06ea-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Flow 'volume_create_manager' (50b9a0e9-9d3e-413b-8e62-3df5b6630397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2658602-f5b3-4610-9267-a8a725cd6466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:00 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2658602-f5b3-4610-9267-a8a725cd6466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010476762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1ffc16-3af5-4dfc-877b-6feb0988e1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94c4e311d374f99aa044cd47b0d09d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:00Z,use_quota=True,user_id='43c247c48b744c42be8613735b5a2a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81832f9c-0893-469e-80a4-5f7ccd6dd1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81832f9c-0893-469e-80a4-5f7ccd6dd1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81caa4e1-5ca4-435e-9f42-c355084bac8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81caa4e1-5ca4-435e-9f42-c355084bac8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed1ffc16-3af5-4dfc-877b-6feb0988e1dd', 'volume_name': 'volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b822c37d-c813-421b-bf2d-43bd3e5ae3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b822c37d-c813-421b-bf2d-43bd3e5ae3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50704aff-91fc-41cd-8967-657e1a485fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Volume ed1ffc16-3af5-4dfc-877b-6feb0988e1dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd', 'volume_size': 1} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1010476762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed1ffc16-3af5-4dfc-877b-6feb0988e1dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94c4e311d374f99aa044cd47b0d09d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:00Z,use_quota=True,user_id='43c247c48b744c42be8613735b5a2a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Creating volume ed1ffc16-3af5-4dfc-877b-6feb0988e1dd {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:00 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89e02bc5-72ed-45b6-8d98-f5e7cf635fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac947d3-c2f6-43d3-96bf-a0849c11024b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ed0021-8989-4b44-a76b-6aad836a5ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:00 devstack sudo[107917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd 1073741824 Sep 09 17:05:00 devstack sudo[107917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:00 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Volume volume-cac947d3-c2f6-43d3-96bf-a0849c11024b (cac947d3-c2f6-43d3-96bf-a0849c11024b): created successfully Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ed0021-8989-4b44-a76b-6aad836a5ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (6002c1d7-370b-4027-8fb9-611fee62fc2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b1f7f663-98dd-4fe6-a82e-038cbbce424a tempest-ProjectMemberTests-1056521081 None] Created volume successfully. Sep 09 17:05:00 devstack sudo[107917]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd 1073741824" returned: 0 in 0.477s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:00 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd Sep 09 17:05:00 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:01 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd" returned: 0 in 0.331s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50704aff-91fc-41cd-8967-657e1a485fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9873335-a9be-4b6c-8c9d-0a0f41173e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Flow 'volume_create_manager' (08430a50-ff22-4c0f-a411-e603cc0ef5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85e8d8e-d0e1-471c-b8ea-7f5a1625b3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Volume volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd (ed1ffc16-3af5-4dfc-877b-6feb0988e1dd): created successfully Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9873335-a9be-4b6c-8c9d-0a0f41173e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Flow 'volume_create_manager' (50b9a0e9-9d3e-413b-8e62-3df5b6630397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c85e8d8e-d0e1-471c-b8ea-7f5a1625b3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078557493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b2d461-f83a-499e-bc47-69fab4808e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b5204519494ca1906af4d7be979dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:01Z,use_quota=True,user_id='2437268613e941d69d59ba1865b941a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b9004a-67b8-4a16-8117-b8debf3dde82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5b9004a-67b8-4a16-8117-b8debf3dde82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25380ba6-e49a-4395-9c17-2b431bcd3b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25380ba6-e49a-4395-9c17-2b431bcd3b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b2d461-f83a-499e-bc47-69fab4808e9b', 'volume_name': 'volume-34b2d461-f83a-499e-bc47-69fab4808e9b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebcfc5c5-f5a2-4c4a-a412-e943b6c520cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebcfc5c5-f5a2-4c4a-a412-e943b6c520cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adc0fab-df3f-4603-8a32-a32e7a60da35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:01 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Volume 34b2d461-f83a-499e-bc47-69fab4808e9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b2d461-f83a-499e-bc47-69fab4808e9b', 'volume_size': 1} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2078557493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b2d461-f83a-499e-bc47-69fab4808e9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b5204519494ca1906af4d7be979dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:01Z,use_quota=True,user_id='2437268613e941d69d59ba1865b941a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Creating volume 34b2d461-f83a-499e-bc47-69fab4808e9b {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:01 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:01 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-81cf275d-3ecc-4ca1-a490-c2d945675023 tempest-ProjectReaderTests-576459998 None] Created volume successfully. Sep 09 17:05:01 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b 1073741824 Sep 09 17:05:01 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:01 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b 1073741824" returned: 0 in 0.511s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:01 devstack sudo[107935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b Sep 09 17:05:01 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:02 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.585s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2adc0fab-df3f-4603-8a32-a32e7a60da35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b2d461-f83a-499e-bc47-69fab4808e9b', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9067e2e4-0607-4f97-93ee-4844e7a75e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Creating offline snapshot f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 of volume cac947d3-c2f6-43d3-96bf-a0849c11024b {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:05:02 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Volume volume-34b2d461-f83a-499e-bc47-69fab4808e9b (34b2d461-f83a-499e-bc47-69fab4808e9b): created successfully Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9067e2e4-0607-4f97-93ee-4844e7a75e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Flow 'volume_create_manager' (08430a50-ff22-4c0f-a411-e603cc0ef5ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a045584-ad6e-4698-94c7-fa200b51e273]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2e851a34-a724-4e7a-a6e5-9c655528a43d tempest-ProjectReaderTests-412387478 None] Created volume successfully. Sep 09 17:05:02 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b Sep 09 17:05:02 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Acquiring lock "cinder-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Lock "cinder-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Acquiring lock "cinder-quobyte-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Lock "cinder-quobyte-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd" acquired by "delete_volume" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8453d09-ef58-43ba-abfa-c3b5d41ab75c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:02 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b" returned: 0 in 0.457s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:02 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 1G Sep 09 17:05:02 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:02 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd Sep 09 17:05:02 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:02 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd" returned: 0 in 0.372s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:03 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd Sep 09 17:05:03 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:03 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 1G" returned: 0 in 0.464s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac947d3-c2f6-43d3-96bf-a0849c11024b -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:03 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac947d3-c2f6-43d3-96bf-a0849c11024b -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 Sep 09 17:05:03 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Acquiring lock "cinder-34b2d461-f83a-499e-bc47-69fab4808e9b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Lock "cinder-34b2d461-f83a-499e-bc47-69fab4808e9b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:03 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Acquiring lock "cinder-quobyte-34b2d461-f83a-499e-bc47-69fab4808e9b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd" returned: 0 in 0.330s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Lock "cinder-quobyte-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd" released by "delete_volume" :: held 0.757s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Lock "cinder-quobyte-34b2d461-f83a-499e-bc47-69fab4808e9b" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8749fd-df6d-414b-a76a-177fa0f6f940]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Created reservations ['5f0cdf1f-1295-4a64-b81b-c26132cad35b', '78582513-8022-42a3-b333-69f122695fcd', '000b61c3-36c6-4f8e-aff4-3e2df39a532a', '7ebf51f8-fddb-481e-8e12-10337a0d44d0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:03 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b Sep 09 17:05:03 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:03 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cac947d3-c2f6-43d3-96bf-a0849c11024b -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036" returned: 0 in 0.443s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:03 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 is being set with open permissions: ugo+rw Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:03 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 Sep 09 17:05:03 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:03 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:03 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Flow 'volume_create_manager' (c98e1078-f2d7-47d1-be25-39f27cf2c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b396a5-55cb-494f-adc9-8d87ba3852fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78b396a5-55cb-494f-adc9-8d87ba3852fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c1b655-e3f7-4dc8-a11b-c0eaaa714242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a7c0aca0524a56a36482f863263eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:04Z,use_quota=True,user_id='1b7d769312ba4007b8eaeec6c39f32cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:03 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50498692-5d60-4cb2-b942-bfacc92f15e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50498692-5d60-4cb2-b942-bfacc92f15e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec579b7a-abce-4239-aa48-161a00976861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec579b7a-abce-4239-aa48-161a00976861) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8c1b655-e3f7-4dc8-a11b-c0eaaa714242', 'volume_name': 'volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594c2e71-44ca-49e4-bcd2-9e62868c17f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594c2e71-44ca-49e4-bcd2-9e62868c17f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c7bc05-35c9-488b-bd75-23e7a76bdba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:03 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Volume f8c1b655-e3f7-4dc8-a11b-c0eaaa714242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242', 'volume_size': 1} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b" returned: 0 in 0.536s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:03 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b Sep 09 17:05:03 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:03 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:03 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Deleted volume successfully. Sep 09 17:05:03 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036" returned: 0 in 0.445s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-4e0e7bf1-ea9e-4126-8255-fbe45b92128d tempest-ProjectReaderTests-576459998 None] Lock "cinder-ed1ffc16-3af5-4dfc-877b-6feb0988e1dd-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:04 devstack sudo[107974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.info Sep 09 17:05:04 devstack sudo[107974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:04 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-34b2d461-f83a-499e-bc47-69fab4808e9b" returned: 0 in 0.312s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Flow 'volume_create_manager' (1f0574ea-5387-4b7f-b348-0b6319a3b294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6d5b40-1cda-4d67-8073-faeda817e926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Lock "cinder-quobyte-34b2d461-f83a-499e-bc47-69fab4808e9b" released by "delete_volume" :: held 0.929s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb6d5b40-1cda-4d67-8073-faeda817e926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304412459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae83e0ff-914a-4eeb-8814-70e3454adb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94c4e311d374f99aa044cd47b0d09d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:04Z,use_quota=True,user_id='43c247c48b744c42be8613735b5a2a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d44ff39-4c51-41f6-86d9-eab482587bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d44ff39-4c51-41f6-86d9-eab482587bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d23021e-186a-4886-b202-05f9ede72ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:04 devstack sudo[107974]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d23021e-186a-4886-b202-05f9ede72ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae83e0ff-914a-4eeb-8814-70e3454adb5e', 'volume_name': 'volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466a681b-a275-478d-8df2-d0e205c90a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (466a681b-a275-478d-8df2-d0e205c90a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d7a549-2bf0-4ae0-ae3a-82ca345e41b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:04 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Volume ae83e0ff-914a-4eeb-8814-70e3454adb5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e', 'volume_size': 1} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.info" returned: 0 in 0.318s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:04 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.info is being set with open permissions: ugo+rw Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:04 devstack sudo[107978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.info Sep 09 17:05:04 devstack sudo[107978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Created reservations ['72560c63-1c6c-4dfb-9e80-e693aab7e4a8', '1451ec2c-ff80-4a96-b1ae-7749d0ea43d0', '94782083-53a5-4481-9375-72e3ef17a649', '9882ab4c-d508-4385-97a4-9676d70901b0'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:04 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:04 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:04 devstack sudo[107978]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.info" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.509s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.721s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c1b655-e3f7-4dc8-a11b-c0eaaa714242,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a7c0aca0524a56a36482f863263eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:04Z,use_quota=True,user_id='1b7d769312ba4007b8eaeec6c39f32cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Creating volume f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:04 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:04 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 1073741824 Sep 09 17:05:04 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-7bffc730-b827-4d1d-8a89-8a33ba70873a tempest-ProjectMemberTests-1056521081 None] Create snapshot completed successfully Sep 09 17:05:04 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Deleted volume successfully. Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=301,cinder:SELECT=216,cinder:INSERT=75,cinder:DELETE=17 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:05:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-709fbed0-2142-461e-b218-5ab16f00f92a tempest-ProjectReaderTests-412387478 None] Lock "cinder-34b2d461-f83a-499e-bc47-69fab4808e9b-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:05 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 1073741824" returned: 0 in 0.403s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=229,cinder:UPDATE=309,cinder:INSERT=86,cinder:DELETE=38 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:05 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 Sep 09 17:05:05 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:05 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1304412459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae83e0ff-914a-4eeb-8814-70e3454adb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d94c4e311d374f99aa044cd47b0d09d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:04Z,use_quota=True,user_id='43c247c48b744c42be8613735b5a2a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Creating volume ae83e0ff-914a-4eeb-8814-70e3454adb5e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:05 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c7bc05-35c9-488b-bd75-23e7a76bdba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb093b2-9eca-4fea-ad20-51e7d9624400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:05 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e 1073741824 Sep 09 17:05:05 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:05 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Volume volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 (f8c1b655-e3f7-4dc8-a11b-c0eaaa714242): created successfully Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fb093b2-9eca-4fea-ad20-51e7d9624400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Flow 'volume_create_manager' (c98e1078-f2d7-47d1-be25-39f27cf2c77f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:05 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fe7c5103-f66d-497f-ae71-d5e2796a5d89 tempest-CinderUnicodeTest-797762684 None] Created volume successfully. Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-f2691c7e-01ea-4f5b-9d1e-8534d3cb6036-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-f2691c7e-01ea-4f5b-9d1e-8534d3cb6036-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-cac947d3-c2f6-43d3-96bf-a0849c11024b" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-cac947d3-c2f6-43d3-96bf-a0849c11024b" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-f2691c7e-01ea-4f5b-9d1e-8534d3cb6036" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-f2691c7e-01ea-4f5b-9d1e-8534d3cb6036" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Deleting offline snapshot f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 of volume cac947d3-c2f6-43d3-96bf-a0849c11024b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] snapshot_file for this snap is: volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc143eef-1297-4e95-b141-ce358b66be10]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:05 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e 1073741824" returned: 0 in 0.616s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:05 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Flow 'volume_create_manager' (5aa7c8b0-c6ad-4f6f-94ca-3a907d0c85c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5065dd20-cc48-43e9-805d-afd5fa2d7278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:06 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 Sep 09 17:05:06 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5065dd20-cc48-43e9-805d-afd5fa2d7278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-238610845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28f0f7a-7a15-424b-a98f-dca407dd3c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b5204519494ca1906af4d7be979dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:06Z,use_quota=True,user_id='2437268613e941d69d59ba1865b941a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:06 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e Sep 09 17:05:06 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72d5830-9372-4158-b531-6fc92d732aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b72d5830-9372-4158-b531-6fc92d732aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10dc6fa-7a5f-4e12-95af-cbe70840ddad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a10dc6fa-7a5f-4e12-95af-cbe70840ddad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28f0f7a-7a15-424b-a98f-dca407dd3c1c', 'volume_name': 'volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9646c41d-3fa9-45ac-8f29-af26329cfb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9646c41d-3fa9-45ac-8f29-af26329cfb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16022c9a-6537-4518-a682-e0c15c8f401c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Volume a28f0f7a-7a15-424b-a98f-dca407dd3c1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c', 'volume_size': 1} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Flow 'volume_create_manager' (5ea08bdb-dbd8-4ce4-b230-903e8ec96fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5c9ab7-8bba-4415-8146-fc7f7d228df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af5c9ab7-8bba-4415-8146-fc7f7d228df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1048207112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48939668-1118-45fc-a0b9-03356e186205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a7c0aca0524a56a36482f863263eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:06Z,use_quota=True,user_id='1b7d769312ba4007b8eaeec6c39f32cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4099d536-d5f8-4285-b834-4c00b6ed729f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4099d536-d5f8-4285-b834-4c00b6ed729f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812ff8fb-9358-4201-9cd0-04075ae4e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (812ff8fb-9358-4201-9cd0-04075ae4e046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48939668-1118-45fc-a0b9-03356e186205', 'volume_name': 'volume-48939668-1118-45fc-a0b9-03356e186205', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c41f87-212b-4c01-9b6f-18be651c3bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c41f87-212b-4c01-9b6f-18be651c3bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a74105-0b88-4793-90e0-2ae8ea54f78f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Volume 48939668-1118-45fc-a0b9-03356e186205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48939668-1118-45fc-a0b9-03356e186205', 'volume_size': 1} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e" returned: 0 in 0.328s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:06 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.242s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-238610845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28f0f7a-7a15-424b-a98f-dca407dd3c1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b5204519494ca1906af4d7be979dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:06Z,use_quota=True,user_id='2437268613e941d69d59ba1865b941a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Creating volume a28f0f7a-7a15-424b-a98f-dca407dd3c1c {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:06 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036" returned: 0 in 0.484s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cac947d3-c2f6-43d3-96bf-a0849c11024b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:05:06 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c 1073741824 Sep 09 17:05:06 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d7a549-2bf0-4ae0-ae3a-82ca345e41b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e2ad55-f38e-4ad3-9c54-4fa27aa28bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a42841e-f6c1-4570-a6fe-bd435daf7d61]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:06 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Volume volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e (ae83e0ff-914a-4eeb-8814-70e3454adb5e): created successfully Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e2ad55-f38e-4ad3-9c54-4fa27aa28bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Flow 'volume_create_manager' (1f0574ea-5387-4b7f-b348-0b6319a3b294) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:06 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-862658e9-2f21-4703-8457-698049a75c8a tempest-ProjectReaderTests-576459998 None] Created volume successfully. Sep 09 17:05:06 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b Sep 09 17:05:06 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:06 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c 1073741824" returned: 0 in 0.434s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:06 devstack sudo[108017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c Sep 09 17:05:06 devstack sudo[108017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:06 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b" returned: 0 in 0.452s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:06 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:06 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 Sep 09 17:05:06 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:07 devstack sudo[108017]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.748s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1048207112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48939668-1118-45fc-a0b9-03356e186205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a7c0aca0524a56a36482f863263eff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:06Z,use_quota=True,user_id='1b7d769312ba4007b8eaeec6c39f32cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Creating volume 48939668-1118-45fc-a0b9-03356e186205 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:07 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16022c9a-6537-4518-a682-e0c15c8f401c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:07 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 1073741824 Sep 09 17:05:07 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05c0965-9a9d-4220-baca-0143a7cd7bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Volume volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c (a28f0f7a-7a15-424b-a98f-dca407dd3c1c): created successfully Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a05c0965-9a9d-4220-baca-0143a7cd7bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Flow 'volume_create_manager' (5aa7c8b0-c6ad-4f6f-94ca-3a907d0c85c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4df2ba2a-823d-4af8-a27f-cb27cc2000fd tempest-ProjectReaderTests-412387478 None] Created volume successfully. Sep 09 17:05:07 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036" returned: 0 in 0.390s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:07 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036 Sep 09 17:05:07 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Acquiring lock "cinder-ae83e0ff-914a-4eeb-8814-70e3454adb5e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Lock "cinder-ae83e0ff-914a-4eeb-8814-70e3454adb5e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Acquiring lock "cinder-quobyte-ae83e0ff-914a-4eeb-8814-70e3454adb5e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Lock "cinder-quobyte-ae83e0ff-914a-4eeb-8814-70e3454adb5e" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e51978ca-8496-4769-83e4-d82df6c979d7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:07 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:07 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b.f2691c7e-01ea-4f5b-9d1e-8534d3cb6036" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 1073741824" returned: 0 in 0.462s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-f2691c7e-01ea-4f5b-9d1e-8534d3cb6036" released by "_delete_snapshot" :: held 1.782s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-cac947d3-c2f6-43d3-96bf-a0849c11024b" released by "delete_snapshot" :: held 1.822s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:07 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e Sep 09 17:05:07 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:07 devstack sudo[108035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 Sep 09 17:05:07 devstack sudo[108035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Created reservations ['7e030f1c-d515-45a0-9102-d84353d24dec', '8f71e0c4-299a-4841-af82-3d0b643d9852', 'e19e86bb-1fb0-4981-8d50-381d9a512e8d', 'ba3675ee-cf62-4a1f-9ee6-98606333155d'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Delete snapshot completed successfully. Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-54275758-77fe-48e6-b6ce-f526dc6d8a51 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-f2691c7e-01ea-4f5b-9d1e-8534d3cb6036-delete_snapshot" released by "delete_snapshot" :: held 2.015s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:07 devstack sudo[108035]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a74105-0b88-4793-90e0-2ae8ea54f78f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48939668-1118-45fc-a0b9-03356e186205', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:07 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69ad045-6492-4df5-85cd-35b203096e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e" returned: 0 in 0.388s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Volume volume-48939668-1118-45fc-a0b9-03356e186205 (48939668-1118-45fc-a0b9-03356e186205): created successfully Sep 09 17:05:07 devstack sudo[108042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e Sep 09 17:05:07 devstack sudo[108042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69ad045-6492-4df5-85cd-35b203096e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Flow 'volume_create_manager' (5ea08bdb-dbd8-4ce4-b230-903e8ec96fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:07 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-2f6020d2-0cba-4006-9f97-8180056ee659 tempest-CinderUnicodeTest-797762684 None] Created volume successfully. Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-cac947d3-c2f6-43d3-96bf-a0849c11024b-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-cac947d3-c2f6-43d3-96bf-a0849c11024b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Acquiring lock "cinder-a28f0f7a-7a15-424b-a98f-dca407dd3c1c-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Lock "cinder-a28f0f7a-7a15-424b-a98f-dca407dd3c1c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-cac947d3-c2f6-43d3-96bf-a0849c11024b" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:08 devstack sudo[108042]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-cac947d3-c2f6-43d3-96bf-a0849c11024b" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-ae83e0ff-914a-4eeb-8814-70e3454adb5e" returned: 0 in 0.300s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6276cd-ac14-49ee-9e82-c5d71de4971a]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Acquiring lock "cinder-quobyte-a28f0f7a-7a15-424b-a98f-dca407dd3c1c" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Lock "cinder-quobyte-ae83e0ff-914a-4eeb-8814-70e3454adb5e" released by "delete_volume" :: held 0.751s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Lock "cinder-quobyte-a28f0f7a-7a15-424b-a98f-dca407dd3c1c" acquired by "delete_volume" :: waited 0.032s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d904306c-9a28-4b69-a7dd-98794fdab6bf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Created reservations ['126661f8-3afa-4389-92c4-16488add57b2', 'd1cb225a-89e9-4c90-aaaf-1d400f701700', 'ea490d2e-0b89-4875-93f5-60246437fd39', '82f3663f-5781-445e-b548-8ec8ca81c41c'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:08 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b Sep 09 17:05:08 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:08 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c Sep 09 17:05:08 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:08 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:08 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:08 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b" returned: 0 in 0.563s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:08 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Creating offline snapshot b80fbcb7-b618-4741-9dc7-94e91e3ea128 of volume 48939668-1118-45fc-a0b9-03356e186205 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.381s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:08 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b Sep 09 17:05:08 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Deleted volume successfully. Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3618a437-0cae-46f7-b607-09541e7f32ca]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:08 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c" returned: 0 in 0.568s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:08 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-78b7b427-5c11-4b89-959d-3ab60886e35e tempest-ProjectReaderTests-576459998 None] Lock "cinder-ae83e0ff-914a-4eeb-8814-70e3454adb5e-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:08 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c Sep 09 17:05:08 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:09 devstack sudo[108061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 Sep 09 17:05:09 devstack sudo[108061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:09 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-cac947d3-c2f6-43d3-96bf-a0849c11024b" returned: 0 in 0.290s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-cac947d3-c2f6-43d3-96bf-a0849c11024b" released by "delete_volume" :: held 0.924s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Created reservations ['256c3cda-a8fd-4784-91ab-048b87242602', '356b5ab3-5599-4931-8bfd-ee4c515210e5', '19769399-c555-43f4-8166-0aad3cfb6bd9', '58a9190a-7a46-4ac8-b671-4300982bf9ff'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:09 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-a28f0f7a-7a15-424b-a98f-dca407dd3c1c" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Lock "cinder-quobyte-a28f0f7a-7a15-424b-a98f-dca407dd3c1c" released by "delete_volume" :: held 0.999s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:09 devstack sudo[108061]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205" returned: 0 in 0.484s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:09 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:09 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:09 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 1G Sep 09 17:05:09 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Created reservations ['56a7ed69-558f-475c-b8c7-ea0f64bf6ef5', '277c0d5e-f047-493e-b25b-b0374c032ede', '2db782dc-0e33-4685-a2de-ff68e8c2d525', '3d789a8c-16fa-4638-8cc7-712ed1cee109'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:09 devstack sudo[108074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:09 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:09 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.295s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Deleted volume successfully. Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c6bd3725-d42a-4e99-8b8a-05e53b14c0f6 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-cac947d3-c2f6-43d3-96bf-a0849c11024b-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:09 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.306s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:09 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Deleted volume successfully. Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-568146f4-ec90-440e-904d-4d23968dca19 tempest-ProjectReaderTests-412387478 None] Lock "cinder-a28f0f7a-7a15-424b-a98f-dca407dd3c1c-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:09 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 1G" returned: 0 in 0.565s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48939668-1118-45fc-a0b9-03356e186205 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:09 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48939668-1118-45fc-a0b9-03356e186205 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 Sep 09 17:05:09 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:10 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48939668-1118-45fc-a0b9-03356e186205 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128" returned: 0 in 0.303s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:10 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 is being set with open permissions: ugo+rw Sep 09 17:05:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:10 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 Sep 09 17:05:10 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:10 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128" returned: 0 in 0.306s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:10 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.info Sep 09 17:05:10 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:10 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.info" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:10 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.info is being set with open permissions: ugo+rw Sep 09 17:05:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:10 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.info Sep 09 17:05:10 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:11 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.info" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.436s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (bb3c46dd-dfee-4fe2-8567-1df6633b242a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b7453f-745a-4115-a70b-4efcc38188b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:11 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-afdadc7a-f5b6-40fc-8fa0-cee54fc123b0 tempest-CinderUnicodeTest-797762684 None] Create snapshot completed successfully Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Flow 'volume_create_manager' (01ef4fc5-6ab6-4a99-8135-8a5294b9b42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e372395-a1d7-4185-bd4c-22848be4b4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13b7453f-745a-4115-a70b-4efcc38188b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-884296892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c500f2d7-cb5e-4b33-aa98-56a7e343c359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:11Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220cbd91-1ba7-45d6-bb6b-642af555e99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220cbd91-1ba7-45d6-bb6b-642af555e99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61574548-7c4b-48e0-a0c5-8848505547f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61574548-7c4b-48e0-a0c5-8848505547f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c500f2d7-cb5e-4b33-aa98-56a7e343c359', 'volume_name': 'volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f6de0e-7de4-46d5-9181-d97e2bbfd1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f6de0e-7de4-46d5-9181-d97e2bbfd1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ab09c9-78fa-4fad-b60c-0d7502f1f96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Volume c500f2d7-cb5e-4b33-aa98-56a7e343c359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359', 'volume_size': 1} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-884296892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c500f2d7-cb5e-4b33-aa98-56a7e343c359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:11Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Creating volume c500f2d7-cb5e-4b33-aa98-56a7e343c359 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:11 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e372395-a1d7-4185-bd4c-22848be4b4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178377059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32e89a1-4cb0-465c-9c5c-d4476be27b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b5204519494ca1906af4d7be979dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:11Z,use_quota=True,user_id='2437268613e941d69d59ba1865b941a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590db175-b6df-43fc-80f8-2341bca1236f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:11 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 1073741824 Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590db175-b6df-43fc-80f8-2341bca1236f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:11 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8367b0d1-4138-46d0-b5d5-5359c342e1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8367b0d1-4138-46d0-b5d5-5359c342e1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e32e89a1-4cb0-465c-9c5c-d4476be27b28', 'volume_name': 'volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310b5bde-acb7-4aa7-b489-b94a371c4b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310b5bde-acb7-4aa7-b489-b94a371c4b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1745f9f0-19b0-4b89-af49-0568501d3e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:11 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Volume e32e89a1-4cb0-465c-9c5c-d4476be27b28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28', 'volume_size': 1} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:11 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 1073741824" returned: 0 in 0.453s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Acquiring lock "cinder-b80fbcb7-b618-4741-9dc7-94e91e3ea128-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:11 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 Sep 09 17:05:11 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Lock "cinder-b80fbcb7-b618-4741-9dc7-94e91e3ea128-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Acquiring lock "cinder-quobyte-48939668-1118-45fc-a0b9-03356e186205" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Lock "cinder-quobyte-48939668-1118-45fc-a0b9-03356e186205" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Acquiring lock "cinder-quobyte-b80fbcb7-b618-4741-9dc7-94e91e3ea128" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Lock "cinder-quobyte-b80fbcb7-b618-4741-9dc7-94e91e3ea128" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Deleting offline snapshot b80fbcb7-b618-4741-9dc7-94e91e3ea128 of volume 48939668-1118-45fc-a0b9-03356e186205 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] snapshot_file for this snap is: volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[a638ebce-5601-41a3-983c-bb8a6ca5e761]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:12 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 Sep 09 17:05:12 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:12 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359" returned: 0 in 0.283s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1178377059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e32e89a1-4cb0-465c-9c5c-d4476be27b28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51b5204519494ca1906af4d7be979dcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:11Z,use_quota=True,user_id='2437268613e941d69d59ba1865b941a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Creating volume e32e89a1-4cb0-465c-9c5c-d4476be27b28 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:12 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8ab09c9-78fa-4fad-b60c-0d7502f1f96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:12 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28 1073741824 Sep 09 17:05:12 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d4d5c8-d456-4db9-b14d-84f75aade88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Volume volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 (c500f2d7-cb5e-4b33-aa98-56a7e343c359): created successfully Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77d4d5c8-d456-4db9-b14d-84f75aade88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (bb3c46dd-dfee-4fe2-8567-1df6633b242a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-45a07b2f-683f-454e-8d72-6fed31c22382 tempest-ProjectMemberTests-1056521081 None] Created volume successfully. Sep 09 17:05:12 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48939668-1118-45fc-a0b9-03356e186205(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c1d5de-8ecb-4a63-ba6e-a958b142d208]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:12 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 Sep 09 17:05:12 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:12 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28 1073741824" returned: 0 in 0.435s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:12 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28 Sep 09 17:05:12 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:12 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205" returned: 0 in 0.402s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:12 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 Sep 09 17:05:12 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:12 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1745f9f0-19b0-4b89-af49-0568501d3e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55642338-7f77-4130-a027-05050112c7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:12 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Volume volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28 (e32e89a1-4cb0-465c-9c5c-d4476be27b28): created successfully Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55642338-7f77-4130-a027-05050112c7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:12 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Flow 'volume_create_manager' (01ef4fc5-6ab6-4a99-8135-8a5294b9b42f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-b3ff8168-5de1-4441-8a61-86e5f63c14cb tempest-ProjectReaderTests-412387478 None] Created volume successfully. Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Acquiring lock "cinder-e32e89a1-4cb0-465c-9c5c-d4476be27b28-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Lock "cinder-e32e89a1-4cb0-465c-9c5c-d4476be27b28-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Acquiring lock "cinder-quobyte-e32e89a1-4cb0-465c-9c5c-d4476be27b28" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Lock "cinder-quobyte-e32e89a1-4cb0-465c-9c5c-d4476be27b28" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:13 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128" returned: 0 in 0.456s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf2d05a-bc74-437b-a1b2-6b3f618307c8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:13 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128 Sep 09 17:05:13 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Creating offline snapshot 1ff9f54c-469c-4917-85a1-d247c1800d05 of volume c500f2d7-cb5e-4b33-aa98-56a7e343c359 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[779e11b7-2f51-456e-ad3e-02377434e9c7]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:13 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28 Sep 09 17:05:13 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:13 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 Sep 09 17:05:13 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:13 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205.b80fbcb7-b618-4741-9dc7-94e91e3ea128" returned: 0 in 0.267s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Lock "cinder-quobyte-b80fbcb7-b618-4741-9dc7-94e91e3ea128" released by "_delete_snapshot" :: held 1.621s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Lock "cinder-quobyte-48939668-1118-45fc-a0b9-03356e186205" released by "delete_snapshot" :: held 1.652s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Created reservations ['60f97e60-5ef4-4850-8f59-fc36a380d525', '06079efe-722b-4952-95a6-1850e2e539df', '2fea339d-7324-4e6a-a2e6-937154584b3a', 'efda45e7-5aea-4ae5-bef1-23b7f1283785'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:13 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28" returned: 0 in 0.411s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:13 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28 Sep 09 17:05:13 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:13 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Delete snapshot completed successfully. Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c680a579-078f-40e0-98f9-c41e47c88c37 tempest-CinderUnicodeTest-797762684 None] Lock "cinder-b80fbcb7-b618-4741-9dc7-94e91e3ea128-delete_snapshot" released by "delete_snapshot" :: held 1.824s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:13 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359" returned: 0 in 0.429s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:13 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 1G Sep 09 17:05:13 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:13 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e32e89a1-4cb0-465c-9c5c-d4476be27b28" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Lock "cinder-quobyte-e32e89a1-4cb0-465c-9c5c-d4476be27b28" released by "delete_volume" :: held 0.704s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Created reservations ['0ce5fbb6-856e-4b40-85ce-304c481948a1', 'bb15e224-6ee4-4dec-b705-b9a105f32a75', 'da94b05d-bec9-4ef7-868d-5a3e9a609e8b', '02c0793b-ac2f-4f3e-9345-a738c9141252'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Acquiring lock "cinder-48939668-1118-45fc-a0b9-03356e186205-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:14 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:14 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Lock "cinder-48939668-1118-45fc-a0b9-03356e186205-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Acquiring lock "cinder-quobyte-48939668-1118-45fc-a0b9-03356e186205" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Lock "cinder-quobyte-48939668-1118-45fc-a0b9-03356e186205" acquired by "delete_volume" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1e6500-c036-4035-9cb0-a86842ad8b29]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:14 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 1G" returned: 0 in 0.517s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:14 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 Sep 09 17:05:14 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:14 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 Sep 09 17:05:14 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:14 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.327s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Deleted volume successfully. Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-610db5f5-1f93-4805-b228-7a46d3a78b00 tempest-ProjectReaderTests-412387478 None] Lock "cinder-e32e89a1-4cb0-465c-9c5c-d4476be27b28-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:14 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05" returned: 0 in 0.365s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:14 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 is being set with open permissions: ugo+rw Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:14 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 Sep 09 17:05:14 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:14 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205" returned: 0 in 0.453s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:14 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205 Sep 09 17:05:14 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:14 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:15 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-48939668-1118-45fc-a0b9-03356e186205" returned: 0 in 0.274s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:15 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.info Sep 09 17:05:15 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Lock "cinder-quobyte-48939668-1118-45fc-a0b9-03356e186205" released by "delete_volume" :: held 0.792s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Created reservations ['5732d6ef-fa03-42b3-b5ce-72f0c443a2f4', '03488600-c9b3-4f53-95b5-9668c640bee0', 'd1ef1866-ffb4-42a6-941f-9adadb2ff92a', '80747b4d-4d02-4585-ba0d-f0854aada9f2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:15 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:15 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:15 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.info" returned: 0 in 0.278s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:15 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.info is being set with open permissions: ugo+rw Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:15 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.info Sep 09 17:05:15 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Acquiring lock "cinder-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Lock "cinder-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:15 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.286s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Deleted volume successfully. Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-39dccb4e-9ba1-4199-928d-bcd48a128c6e tempest-CinderUnicodeTest-797762684 None] Lock "cinder-48939668-1118-45fc-a0b9-03356e186205-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Acquiring lock "cinder-quobyte-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Lock "cinder-quobyte-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0d5dc7-1eaa-4a77-b96f-5f4538770f43]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:15 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.info" returned: 0 in 0.410s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.415s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:15 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 Sep 09 17:05:15 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-48ded062-7d73-417a-bb8d-de54e9e774d6 tempest-ProjectMemberTests-1056521081 None] Create snapshot completed successfully Sep 09 17:05:15 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:15 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242 Sep 09 17:05:15 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:16 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Lock "cinder-quobyte-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242" released by "delete_volume" :: held 0.706s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Created reservations ['5ff2b496-5084-4c77-84a4-86c783274c64', '6c99acf4-df8d-4046-b3a5-a03f8dace031', 'd59bf29b-47a9-4701-9b5b-3f9bc79a0cf6', '52673640-f6fc-4dc0-bdde-a017ab41bbc7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:16 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:16 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-1ff9f54c-469c-4917-85a1-d247c1800d05-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Lock "cinder-1ff9f54c-469c-4917-85a1-d247c1800d05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-c500f2d7-cb5e-4b33-aa98-56a7e343c359" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-c500f2d7-cb5e-4b33-aa98-56a7e343c359" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-1ff9f54c-469c-4917-85a1-d247c1800d05" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-1ff9f54c-469c-4917-85a1-d247c1800d05" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Deleting offline snapshot 1ff9f54c-469c-4917-85a1-d247c1800d05 of volume c500f2d7-cb5e-4b33-aa98-56a7e343c359 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] snapshot_file for this snap is: volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90ff57e-0450-4835-8d37-41453986722e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:16 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:16 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Deleted volume successfully. Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-00d0e05e-61a3-4389-b620-32eab44cd77a tempest-CinderUnicodeTest-797762684 None] Lock "cinder-f8c1b655-e3f7-4dc8-a11b-c0eaaa714242-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:16 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 Sep 09 17:05:16 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:16 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:16 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:05:17 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[564461f0-3305-4a47-842b-8730715b535d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:17 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 Sep 09 17:05:17 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:17 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:17 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 Sep 09 17:05:17 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:17 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05" returned: 0 in 0.360s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:17 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05 Sep 09 17:05:17 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:18 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359.1ff9f54c-469c-4917-85a1-d247c1800d05" returned: 0 in 0.279s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-1ff9f54c-469c-4917-85a1-d247c1800d05" released by "_delete_snapshot" :: held 1.535s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-c500f2d7-cb5e-4b33-aa98-56a7e343c359" released by "delete_snapshot" :: held 1.559s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Created reservations ['6eeebc12-9063-4563-b563-18cfa18d2c07', 'cccd9ea9-2782-49d0-8771-b83d2b8dd3a8', 'bdcf1f74-f26e-48e3-832d-947250f46644', 'b2352735-0f4f-4e26-8cba-394907deb4fb'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:18 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Delete snapshot completed successfully. Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5c4fbee7-70a0-45ed-be4a-663b3a997dfd tempest-ProjectMemberTests-1056521081 None] Lock "cinder-1ff9f54c-469c-4917-85a1-d247c1800d05-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-c500f2d7-cb5e-4b33-aa98-56a7e343c359-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-c500f2d7-cb5e-4b33-aa98-56a7e343c359-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-c500f2d7-cb5e-4b33-aa98-56a7e343c359" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-c500f2d7-cb5e-4b33-aa98-56a7e343c359" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc57e18a-8f80-4379-be1d-60b04373e2de]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:18 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 Sep 09 17:05:18 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:19 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359" returned: 0 in 0.379s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:19 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359 Sep 09 17:05:19 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:19 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-c500f2d7-cb5e-4b33-aa98-56a7e343c359" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-c500f2d7-cb5e-4b33-aa98-56a7e343c359" released by "delete_volume" :: held 0.677s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Created reservations ['92ac2d8d-5490-473e-a2d1-38a690c5e94e', '8dd08cae-b858-4826-9ba6-1d437e908817', 'cba1f9c6-17a9-4cd8-a76b-1a9525c7eb22', '41496a98-ddc7-43cd-9fe4-ffdfcd032680'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:19 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:19 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4d83860d-606b-476c-9a62-699d738125a0 tempest-ProjectAdminTests-1850413594 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.3467407226562, 'free_capacity_gb': 1773.3467407226562, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87498) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 09 17:05:19 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.260s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Deleted volume successfully. Sep 09 17:05:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-05357b1f-f94c-43d4-94a8-061ea784b429 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-c500f2d7-cb5e-4b33-aa98-56a7e343c359-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (0a28c54c-2bf5-4e3c-a318-5d2df2e5aea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee5bf86-33ae-4a58-a7c6-58e223f72961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aee5bf86-33ae-4a58-a7c6-58e223f72961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77942118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db30a3ca-6e49-4a3b-b92d-7ca1ee98db59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:20Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cd93a1-8951-4daa-b467-d111889b70f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48cd93a1-8951-4daa-b467-d111889b70f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7767d417-b719-4e4d-ac96-7ba815b50a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7767d417-b719-4e4d-ac96-7ba815b50a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db30a3ca-6e49-4a3b-b92d-7ca1ee98db59', 'volume_name': 'volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6ffcaa-a455-4796-8a41-df5ba389a77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e6ffcaa-a455-4796-8a41-df5ba389a77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786c9d7d-9325-4e60-82dd-3e0f097c56b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Volume db30a3ca-6e49-4a3b-b92d-7ca1ee98db59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59', 'volume_size': 1} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-77942118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db30a3ca-6e49-4a3b-b92d-7ca1ee98db59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:20Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Creating volume db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:20 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 1073741824 Sep 09 17:05:20 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:20 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 1073741824" returned: 0 in 0.437s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:20 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 Sep 09 17:05:20 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:21 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786c9d7d-9325-4e60-82dd-3e0f097c56b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48ce001-8ee9-4d42-aa96-04973465dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Volume volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 (db30a3ca-6e49-4a3b-b92d-7ca1ee98db59): created successfully Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c48ce001-8ee9-4d42-aa96-04973465dda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (0a28c54c-2bf5-4e3c-a318-5d2df2e5aea9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-26708a5f-4cee-4382-a4fb-ca29f12a4384 tempest-ProjectMemberTests-1056521081 None] Created volume successfully. Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Creating offline snapshot 57579a57-53b8-432c-8041-60b115cfd05e of volume db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0773f7-1ca8-43ef-9068-4b4bc95cf802]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:21 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 Sep 09 17:05:21 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:21 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:21 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e 1G Sep 09 17:05:21 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:22 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e 1G" returned: 0 in 0.406s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:22 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e Sep 09 17:05:22 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:22 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e" returned: 0 in 0.311s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:22 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e is being set with open permissions: ugo+rw Sep 09 17:05:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:22 devstack sudo[108246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e Sep 09 17:05:22 devstack sudo[108246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:22 devstack sudo[108246]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e" returned: 0 in 0.252s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:22 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.info Sep 09 17:05:22 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:23 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.info" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:23 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.info is being set with open permissions: ugo+rw Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:23 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.info Sep 09 17:05:23 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:23 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.info" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-faaf675a-4cde-45de-9ab2-386affae3f48 tempest-ProjectMemberTests-1056521081 None] Create snapshot completed successfully Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-57579a57-53b8-432c-8041-60b115cfd05e-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-57579a57-53b8-432c-8041-60b115cfd05e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-57579a57-53b8-432c-8041-60b115cfd05e" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-57579a57-53b8-432c-8041-60b115cfd05e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Deleting offline snapshot 57579a57-53b8-432c-8041-60b115cfd05e of volume db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] snapshot_file for this snap is: volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[179511c9-4768-4024-995e-ffdb88fca530]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:23 devstack sudo[108255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e Sep 09 17:05:23 devstack sudo[108255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:24 devstack sudo[108255]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e" returned: 0 in 0.362s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:05:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7495f8-f51d-4d6b-8bf9-d2a789b5d111]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:24 devstack sudo[108260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 Sep 09 17:05:24 devstack sudo[108260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:24 devstack sudo[108260]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:24 devstack sudo[108265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e Sep 09 17:05:24 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:24 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:24 devstack sudo[108270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e Sep 09 17:05:24 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:25 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59.57579a57-53b8-432c-8041-60b115cfd05e" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-57579a57-53b8-432c-8041-60b115cfd05e" released by "_delete_snapshot" :: held 1.468s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" released by "delete_snapshot" :: held 1.494s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Created reservations ['b63f2ad4-828a-4e53-a1c3-fe6516a1235c', 'a7e52152-c1d2-4185-bcc3-34f9666e7db0', 'a8cef103-6b38-4f5f-a4a1-b4141a2e95f1', '22597ccc-725c-4a8f-9415-727d95330a1a'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:25 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Delete snapshot completed successfully. Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-eb0e40a8-9593-46d5-a323-784dff3e5224 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-57579a57-53b8-432c-8041-60b115cfd05e-delete_snapshot" released by "delete_snapshot" :: held 1.657s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Lock "cinder-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[708dfdb4-721d-4e5e-9733-c669877bcf74]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:26 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 Sep 09 17:05:26 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:26 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:26 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59 Sep 09 17:05:26 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:26 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" returned: 0 in 0.258s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59" released by "delete_volume" :: held 0.694s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Created reservations ['b2b26215-1acd-45a3-97ef-a5537fea63e9', 'e862646c-0131-4984-a570-0554751434f2', 'fa9d7e67-2590-4b61-b90a-09f1b1da6afe', '92076767-131b-4772-8775-d99cf161c4e8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:26 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:26 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:26 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Deleted volume successfully. Sep 09 17:05:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc18e247-7a54-4a93-a98a-2583f80d982c tempest-ProjectMemberTests-1056521081 None] Lock "cinder-db30a3ca-6e49-4a3b-b92d-7ca1ee98db59-delete_volume" released by "delete_volume" :: held 1.170s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (462a380b-1145-4061-a5f7-ca9667e06167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c6b8bf-0f7a-4d80-8a5f-41050b3ac18c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1c6b8bf-0f7a-4d80-8a5f-41050b3ac18c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607121515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c792bca-e0c1-4d08-adc9-322eaa976187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:27Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d18644c-81ff-437d-82a9-711f82917321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d18644c-81ff-437d-82a9-711f82917321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c6ffd9-8845-4b40-bf18-884dae2edb2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06c6ffd9-8845-4b40-bf18-884dae2edb2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c792bca-e0c1-4d08-adc9-322eaa976187', 'volume_name': 'volume-3c792bca-e0c1-4d08-adc9-322eaa976187', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8682265-f0be-49cf-be17-528142fd2927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8682265-f0be-49cf-be17-528142fd2927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2f421f-0daa-45c3-b5bd-6bb6fe399629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:27 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Volume 3c792bca-e0c1-4d08-adc9-322eaa976187: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c792bca-e0c1-4d08-adc9-322eaa976187', 'volume_size': 1} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-607121515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c792bca-e0c1-4d08-adc9-322eaa976187,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:27Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Creating volume 3c792bca-e0c1-4d08-adc9-322eaa976187 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:27 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:27 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 1073741824 Sep 09 17:05:27 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:28 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 1073741824" returned: 0 in 0.478s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:28 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 Sep 09 17:05:28 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:28 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187" returned: 0 in 0.273s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2f421f-0daa-45c3-b5bd-6bb6fe399629) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c792bca-e0c1-4d08-adc9-322eaa976187', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42535723-9afc-4efd-9cc4-db499bf4b868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Volume volume-3c792bca-e0c1-4d08-adc9-322eaa976187 (3c792bca-e0c1-4d08-adc9-322eaa976187): created successfully Sep 09 17:05:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42535723-9afc-4efd-9cc4-db499bf4b868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (462a380b-1145-4061-a5f7-ca9667e06167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-76995999-ef15-4eea-87b0-4147b5fd23e6 tempest-ProjectMemberTests-1056521081 None] Created volume successfully. Sep 09 17:05:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Creating offline snapshot 461fe96d-7ce3-460a-8b03-edd47b161353 of volume 3c792bca-e0c1-4d08-adc9-322eaa976187 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:05:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[18652796-3230-42ad-bd4c-f24c44d71a44]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:29 devstack sudo[108296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 Sep 09 17:05:29 devstack sudo[108296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:30 devstack sudo[108296]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187" returned: 0 in 0.377s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:30 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 1G Sep 09 17:05:30 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:30 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 1G" returned: 0 in 0.408s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c792bca-e0c1-4d08-adc9-322eaa976187 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:30 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c792bca-e0c1-4d08-adc9-322eaa976187 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 Sep 09 17:05:30 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:30 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c792bca-e0c1-4d08-adc9-322eaa976187 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:30 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 is being set with open permissions: ugo+rw Sep 09 17:05:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:30 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 Sep 09 17:05:30 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:31 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:31 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.info Sep 09 17:05:31 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:31 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.info" returned: 0 in 0.266s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:31 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.info is being set with open permissions: ugo+rw Sep 09 17:05:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:31 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.info Sep 09 17:05:31 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:31 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.info" returned: 0 in 0.268s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8b5bd0ec-d7a6-475e-a6a0-309ad9caa468 tempest-ProjectMemberTests-1056521081 None] Create snapshot completed successfully Sep 09 17:05:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-461fe96d-7ce3-460a-8b03-edd47b161353-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-461fe96d-7ce3-460a-8b03-edd47b161353-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-3c792bca-e0c1-4d08-adc9-322eaa976187" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-3c792bca-e0c1-4d08-adc9-322eaa976187" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-461fe96d-7ce3-460a-8b03-edd47b161353" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-461fe96d-7ce3-460a-8b03-edd47b161353" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Deleting offline snapshot 461fe96d-7ce3-460a-8b03-edd47b161353 of volume 3c792bca-e0c1-4d08-adc9-322eaa976187 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:05:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] snapshot_file for this snap is: volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:05:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae284943-174f-4698-b9a2-d9b269167887]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:33 devstack sudo[108358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 Sep 09 17:05:33 devstack sudo[108358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:33 devstack sudo[108358]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353" returned: 0 in 0.375s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:33 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c792bca-e0c1-4d08-adc9-322eaa976187(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:05:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc574e3-74b5-4354-88e5-2c212dbd42b6]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:33 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 Sep 09 17:05:33 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:33 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:33 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 Sep 09 17:05:33 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:34 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:34 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353 Sep 09 17:05:34 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:34 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187.461fe96d-7ce3-460a-8b03-edd47b161353" returned: 0 in 0.264s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-461fe96d-7ce3-460a-8b03-edd47b161353" released by "_delete_snapshot" :: held 1.477s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-3c792bca-e0c1-4d08-adc9-322eaa976187" released by "delete_snapshot" :: held 1.504s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Created reservations ['058480b9-a513-48a5-b550-af34f3bc280c', 'bdee1c86-a05a-4d38-b5e6-c1881cf982fb', '4dd416f0-2a7d-49aa-af96-53dcbfdbb282', 'a2d19885-2043-41d3-bbf4-b2f52ba0b73b'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Delete snapshot completed successfully. Sep 09 17:05:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9a0dd905-5661-49a8-a366-fc8cc9aee1b0 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-461fe96d-7ce3-460a-8b03-edd47b161353-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-3c792bca-e0c1-4d08-adc9-322eaa976187-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-3c792bca-e0c1-4d08-adc9-322eaa976187-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-3c792bca-e0c1-4d08-adc9-322eaa976187" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-3c792bca-e0c1-4d08-adc9-322eaa976187" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3f771d-f014-44af-80f9-2e0c454278a5]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:35 devstack sudo[108377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 Sep 09 17:05:35 devstack sudo[108377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:35 devstack sudo[108377]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:35 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187 Sep 09 17:05:35 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:35 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-3c792bca-e0c1-4d08-adc9-322eaa976187" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-3c792bca-e0c1-4d08-adc9-322eaa976187" released by "delete_volume" :: held 0.664s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Created reservations ['e43b1d31-20b5-4c85-a747-c2e22e1fdc14', 'e9021792-db8c-4cb7-90ea-6e3afcbf82a8', '3a14c990-b047-465f-835f-f7452910ecaa', 'c59ff173-48b7-44dd-a095-798277588632'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:35 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:35 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:36 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Deleted volume successfully. Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-89b36fee-9f26-4a0a-a62a-f5c18692c5a3 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-3c792bca-e0c1-4d08-adc9-322eaa976187-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (dbaa0f9c-cbee-44d6-ac2b-899dc7fdb98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a76bd1-616c-4a49-9bab-8cb6acd88008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a76bd1-616c-4a49-9bab-8cb6acd88008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57567110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:37Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bf90a0-21dd-4547-bc23-410886cb8564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52bf90a0-21dd-4547-bc23-410886cb8564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cc54da-b18f-40bb-867f-cc873cadabba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cc54da-b18f-40bb-867f-cc873cadabba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc', 'volume_name': 'volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761eb1cb-cb9e-4510-a984-e684903c484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (761eb1cb-cb9e-4510-a984-e684903c484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ff0153-31a5-43fa-983b-b9ea7a6a252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Volume b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc', 'volume_size': 1} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-57567110',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:37Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Creating volume b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:36 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:36 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc 1073741824 Sep 09 17:05:36 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:37 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc 1073741824" returned: 0 in 0.401s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:37 devstack sudo[108395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc Sep 09 17:05:37 devstack sudo[108395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:37 devstack sudo[108395]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" returned: 0 in 0.243s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ff0153-31a5-43fa-983b-b9ea7a6a252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d649fc61-bc12-4038-ab55-ee38be6b1b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:37 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Volume volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc (b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc): created successfully Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d649fc61-bc12-4038-ab55-ee38be6b1b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (dbaa0f9c-cbee-44d6-ac2b-899dc7fdb98e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:37 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-a8a337c1-dd69-459f-aa12-a05cbb7b09ad tempest-ProjectMemberTests-1056521081 None] Created volume successfully. Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Creating offline snapshot 2c3e145d-a220-4107-a25c-95b117bcaf86 of volume b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf16a9a-54a0-4b9b-9537-d0ae27884808]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:37 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc Sep 09 17:05:37 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:38 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:38 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 1G Sep 09 17:05:38 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:38 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 1G" returned: 0 in 0.374s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:38 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 Sep 09 17:05:38 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:38 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86" returned: 0 in 0.282s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:38 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 is being set with open permissions: ugo+rw Sep 09 17:05:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:38 devstack sudo[108415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 Sep 09 17:05:38 devstack sudo[108415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:39 devstack sudo[108415]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:39 devstack sudo[108418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.info Sep 09 17:05:39 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:39 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.info" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:39 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.info is being set with open permissions: ugo+rw Sep 09 17:05:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:39 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.info Sep 09 17:05:39 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:39 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.info" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.778s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:39 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-798f9cda-1dd4-4e8f-ab4c-aa6c1d86de41 tempest-ProjectMemberTests-1056521081 None] Create snapshot completed successfully Sep 09 17:05:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-2c3e145d-a220-4107-a25c-95b117bcaf86-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-2c3e145d-a220-4107-a25c-95b117bcaf86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-2c3e145d-a220-4107-a25c-95b117bcaf86" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-2c3e145d-a220-4107-a25c-95b117bcaf86" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Deleting offline snapshot 2c3e145d-a220-4107-a25c-95b117bcaf86 of volume b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] snapshot_file for this snap is: volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcc690f-fd74-48d7-9762-910375a05903]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:40 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 Sep 09 17:05:40 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:40 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86" returned: 0 in 0.344s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e726e2-6946-4894-aa73-d5b0fc76bc72]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:40 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc Sep 09 17:05:40 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:40 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" returned: 0 in 0.350s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:40 devstack sudo[108434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 Sep 09 17:05:40 devstack sudo[108434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:41 devstack sudo[108434]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86" returned: 0 in 0.313s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:41 devstack sudo[108439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86 Sep 09 17:05:41 devstack sudo[108439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:41 devstack sudo[108439]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc.2c3e145d-a220-4107-a25c-95b117bcaf86" returned: 0 in 0.231s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-2c3e145d-a220-4107-a25c-95b117bcaf86" released by "_delete_snapshot" :: held 1.319s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" released by "delete_snapshot" :: held 1.338s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Created reservations ['8f394372-9f3e-4735-96f4-8348f66a6f1c', 'cec02d19-cfe4-4ab3-a1fb-89b6b47169bf', 'b8398f56-d95d-4940-88be-c3e4cf4a2d65', '8bb6dba2-8b3a-49cf-aca1-5728ff14ed83'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:41 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Delete snapshot completed successfully. Sep 09 17:05:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-756b0e41-c014-486f-92ce-33285d8a5448 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-2c3e145d-a220-4107-a25c-95b117bcaf86-delete_snapshot" released by "delete_snapshot" :: held 1.468s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Lock "cinder-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" acquired by "delete_volume" :: waited 0.019s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[765fb5b0-3879-4555-b835-79be4ac6bbf3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:42 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc Sep 09 17:05:42 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:42 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:42 devstack sudo[108453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc Sep 09 17:05:42 devstack sudo[108453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:42 devstack sudo[108453]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" returned: 0 in 0.227s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc" released by "delete_volume" :: held 0.622s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Created reservations ['06c8fcf8-99f7-4cd2-97e7-faf115c7152f', '9a7b3f16-5052-44dd-9812-e5f7968cc55b', '965e6a4f-b28e-4ae7-bc0a-4d928b012abe', 'bc71cb89-7355-4338-9c47-040fede58dd7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:42 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:42 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:43 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:43 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Deleted volume successfully. Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5208104b-4f86-45ad-a125-d38e2e6d706b tempest-ProjectMemberTests-1056521081 None] Lock "cinder-b45b7683-975d-4cc2-b8b7-5c3e89ecd3dc-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (c09adff5-2652-4786-82e3-edb18952a24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc8800b-b276-4adf-9e93-538f9b8d6a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc8800b-b276-4adf-9e93-538f9b8d6a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942879697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3eacc0e-f444-49f8-8429-063708a111ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:44Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8957ad11-d7e7-4cee-939a-6cc4b975a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8957ad11-d7e7-4cee-939a-6cc4b975a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf68ada8-9038-482f-8e3b-1c8138a4eaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf68ada8-9038-482f-8e3b-1c8138a4eaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3eacc0e-f444-49f8-8429-063708a111ca', 'volume_name': 'volume-f3eacc0e-f444-49f8-8429-063708a111ca', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e6db43-e87e-4fd1-aa0c-5fba9d52a5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9e6db43-e87e-4fd1-aa0c-5fba9d52a5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f04e1b6-fd5c-4923-85c7-3d655bf5abe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:43 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Volume f3eacc0e-f444-49f8-8429-063708a111ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3eacc0e-f444-49f8-8429-063708a111ca', 'volume_size': 1} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942879697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3eacc0e-f444-49f8-8429-063708a111ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:44Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Creating volume f3eacc0e-f444-49f8-8429-063708a111ca {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:43 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:43 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:43 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca 1073741824 Sep 09 17:05:43 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:44 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca 1073741824" returned: 0 in 0.388s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:44 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca Sep 09 17:05:44 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:44 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.663s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f04e1b6-fd5c-4923-85c7-3d655bf5abe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3eacc0e-f444-49f8-8429-063708a111ca', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4285ccca-ca00-4817-b6e7-6a740928f0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:44 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Volume volume-f3eacc0e-f444-49f8-8429-063708a111ca (f3eacc0e-f444-49f8-8429-063708a111ca): created successfully Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4285ccca-ca00-4817-b6e7-6a740928f0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (c09adff5-2652-4786-82e3-edb18952a24a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:44 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0e7b50ef-6274-4cdd-9f31-0847b4bb69a6 tempest-ProjectMemberTests-1056521081 None] Created volume successfully. Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Creating offline snapshot fbfe653a-0b19-4f22-898f-96b475858d18 of volume f3eacc0e-f444-49f8-8429-063708a111ca {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed64ac4-c6a7-4d54-84c8-4a0376fda610]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:44 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:44 devstack sudo[108467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca Sep 09 17:05:44 devstack sudo[108467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:45 devstack sudo[108472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:45 devstack sudo[108472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:45 devstack sudo[108467]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:45 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 1G Sep 09 17:05:45 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:45 devstack sudo[108472]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.227s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:05:45 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 1G" returned: 0 in 0.368s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3eacc0e-f444-49f8-8429-063708a111ca -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:45 devstack sudo[108480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3eacc0e-f444-49f8-8429-063708a111ca -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 Sep 09 17:05:45 devstack sudo[108480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:45 devstack sudo[108480]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3eacc0e-f444-49f8-8429-063708a111ca -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18" returned: 0 in 0.284s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:45 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 is being set with open permissions: ugo+rw Sep 09 17:05:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:45 devstack sudo[108486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 Sep 09 17:05:45 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:46 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18" returned: 0 in 0.225s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:46 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.info Sep 09 17:05:46 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:46 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.info" returned: 0 in 0.234s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:46 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.info is being set with open permissions: ugo+rw Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:46 devstack sudo[108492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.info Sep 09 17:05:46 devstack sudo[108492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:46 devstack sudo[108492]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.info" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.761s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:46 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-e4de631b-26a5-4443-80f1-be219505d096 tempest-ProjectMemberTests-1056521081 None] Create snapshot completed successfully Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-fbfe653a-0b19-4f22-898f-96b475858d18-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-fbfe653a-0b19-4f22-898f-96b475858d18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-f3eacc0e-f444-49f8-8429-063708a111ca" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-f3eacc0e-f444-49f8-8429-063708a111ca" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-fbfe653a-0b19-4f22-898f-96b475858d18" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-fbfe653a-0b19-4f22-898f-96b475858d18" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Deleting offline snapshot fbfe653a-0b19-4f22-898f-96b475858d18 of volume f3eacc0e-f444-49f8-8429-063708a111ca {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:05:46 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] snapshot_file for this snap is: volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:05:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc55cd11-cf41-40ff-9e99-a9d85149dcac]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:47 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 Sep 09 17:05:47 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:47 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:47 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3eacc0e-f444-49f8-8429-063708a111ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:05:47 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aefb565-6525-44c9-9189-799b3903b331]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:47 devstack sudo[108500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca Sep 09 17:05:47 devstack sudo[108500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:47 devstack sudo[108500]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:47 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:47 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 Sep 09 17:05:47 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:48 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18" returned: 0 in 0.323s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:48 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18 Sep 09 17:05:48 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:48 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:48 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca.fbfe653a-0b19-4f22-898f-96b475858d18" returned: 0 in 0.230s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-fbfe653a-0b19-4f22-898f-96b475858d18" released by "_delete_snapshot" :: held 1.323s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-f3eacc0e-f444-49f8-8429-063708a111ca" released by "delete_snapshot" :: held 1.345s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:48 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Created reservations ['8d1f6ac3-65c7-4ea1-9656-2d163eb01e34', '36208632-c2eb-430b-a922-63468b41255d', '936d11a2-3ed7-4c07-8ee3-b10738d1dd77', '49561238-deb5-473f-ab77-fd3bfe542ef7'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:48 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Delete snapshot completed successfully. Sep 09 17:05:48 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-3150a140-1335-4bb4-af1c-7e163fa214a3 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-fbfe653a-0b19-4f22-898f-96b475858d18-delete_snapshot" released by "delete_snapshot" :: held 1.467s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-f3eacc0e-f444-49f8-8429-063708a111ca-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Lock "cinder-f3eacc0e-f444-49f8-8429-063708a111ca-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-f3eacc0e-f444-49f8-8429-063708a111ca" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-f3eacc0e-f444-49f8-8429-063708a111ca" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[18993b02-3932-4a7b-ae4c-850a7b716de8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:49 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca Sep 09 17:05:49 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:49 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:49 devstack sudo[108518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca Sep 09 17:05:49 devstack sudo[108518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:49 devstack sudo[108518]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f3eacc0e-f444-49f8-8429-063708a111ca" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-f3eacc0e-f444-49f8-8429-063708a111ca" released by "delete_volume" :: held 0.636s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Created reservations ['6947f79c-1f7d-4508-9d6d-573a12521537', '275d3980-c722-41f1-9d91-5742698007a7', '2ac947ca-f979-4965-ac1d-79562d8d6d5a', '930ae97e-7649-471f-a5a0-891fd54a7db8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:49 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:49 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:49 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:50 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.230s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:50 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Deleted volume successfully. Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fd9d10f4-9da1-4daf-9875-b53cec4c687a tempest-ProjectMemberTests-1056521081 None] Lock "cinder-f3eacc0e-f444-49f8-8429-063708a111ca-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (6cb54cdd-d5b2-4796-a13a-da6dfcede776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3985237d-f32c-4a44-80a1-f64814302975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3985237d-f32c-4a44-80a1-f64814302975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-281155829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e007c94c-5410-4f38-913d-4188bc4f7567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:51Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d673eb22-476c-4886-8080-0b6a60c83065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d673eb22-476c-4886-8080-0b6a60c83065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a05bc2-b5ac-49fe-b76c-08a4befad29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4a05bc2-b5ac-49fe-b76c-08a4befad29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e007c94c-5410-4f38-913d-4188bc4f7567', 'volume_name': 'volume-e007c94c-5410-4f38-913d-4188bc4f7567', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9495060-e90f-4d63-9798-a5cdd06a05ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9495060-e90f-4d63-9798-a5cdd06a05ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46fd3a6-53a1-47e7-9b06-411bae66fa67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:50 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Volume e007c94c-5410-4f38-913d-4188bc4f7567: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e007c94c-5410-4f38-913d-4188bc4f7567', 'volume_size': 1} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-281155829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e007c94c-5410-4f38-913d-4188bc4f7567,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:51Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Creating volume e007c94c-5410-4f38-913d-4188bc4f7567 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:50 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:50 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:50 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 1073741824 Sep 09 17:05:50 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:51 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 1073741824" returned: 0 in 0.393s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:51 devstack sudo[108529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 Sep 09 17:05:51 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:51 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567" returned: 0 in 0.231s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] <== create_volume: return (662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f46fd3a6-53a1-47e7-9b06-411bae66fa67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e007c94c-5410-4f38-913d-4188bc4f7567', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b0974f-edba-4087-b916-8a2304778a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:51 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Volume volume-e007c94c-5410-4f38-913d-4188bc4f7567 (e007c94c-5410-4f38-913d-4188bc4f7567): created successfully Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4b0974f-edba-4087-b916-8a2304778a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (6cb54cdd-d5b2-4796-a13a-da6dfcede776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:51 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-aeab3ccd-13ce-4c08-948e-99050ddccbd4 tempest-ProjectMemberTests-1056521081 None] Created volume successfully. Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Creating offline snapshot 5468e3e7-769f-48b5-a0db-1415363fcaae of volume e007c94c-5410-4f38-913d-4188bc4f7567 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[162b1836-104a-48cf-89c4-d3b5b8e4c010]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:51 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:51 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 Sep 09 17:05:51 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:52 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:52 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae 1G Sep 09 17:05:52 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:52 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae 1G" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e007c94c-5410-4f38-913d-4188bc4f7567 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:52 devstack sudo[108542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e007c94c-5410-4f38-913d-4188bc4f7567 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae Sep 09 17:05:52 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:52 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e007c94c-5410-4f38-913d-4188bc4f7567 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae" returned: 0 in 0.276s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:52 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae is being set with open permissions: ugo+rw Sep 09 17:05:52 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:52 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae Sep 09 17:05:52 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:53 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae" returned: 0 in 0.232s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:53 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.info Sep 09 17:05:53 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:53 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.info" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:53 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.info is being set with open permissions: ugo+rw Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:53 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.info Sep 09 17:05:53 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:53 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.info" returned: 0 in 0.229s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.765s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:53 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1ef5c00d-ce1b-4f6b-80cf-b9ab64fb2663 tempest-ProjectMemberTests-1056521081 None] Create snapshot completed successfully Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-5468e3e7-769f-48b5-a0db-1415363fcaae-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Lock "cinder-5468e3e7-769f-48b5-a0db-1415363fcaae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-e007c94c-5410-4f38-913d-4188bc4f7567" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-e007c94c-5410-4f38-913d-4188bc4f7567" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-5468e3e7-769f-48b5-a0db-1415363fcaae" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:53 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-5468e3e7-769f-48b5-a0db-1415363fcaae" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Deleting offline snapshot 5468e3e7-769f-48b5-a0db-1415363fcaae of volume e007c94c-5410-4f38-913d-4188bc4f7567 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:05:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] snapshot_file for this snap is: volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:05:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd7a5b7-8e8d-443e-a0f5-ca21c598d4ec]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:54 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae Sep 09 17:05:54 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:54 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:54 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e007c94c-5410-4f38-913d-4188bc4f7567(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:05:54 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[452a2196-0aca-4be5-835f-121e5b54e54c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:54 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 Sep 09 17:05:54 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:54 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:54 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:54 devstack sudo[108566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae Sep 09 17:05:54 devstack sudo[108566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:55 devstack sudo[108566]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae" returned: 0 in 0.322s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:55 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae Sep 09 17:05:55 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:55 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:55 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567.5468e3e7-769f-48b5-a0db-1415363fcaae" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-5468e3e7-769f-48b5-a0db-1415363fcaae" released by "_delete_snapshot" :: held 1.328s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-e007c94c-5410-4f38-913d-4188bc4f7567" released by "delete_snapshot" :: held 1.348s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:55 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Created reservations ['33e9cfc4-0a8d-41e4-93d4-b5737fa87836', 'd0f0840a-3f7a-49bc-ad0d-4ceda0ce587b', 'b5e79efe-5f1a-42b2-a6f2-711d0f4a1fac', 'c7078f0c-538b-43a2-a982-d59bc239a577'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:55 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Delete snapshot completed successfully. Sep 09 17:05:55 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6d4904cf-818c-4907-b845-cfbeb1ff26cf tempest-ProjectMemberTests-1056521081 None] Lock "cinder-5468e3e7-769f-48b5-a0db-1415363fcaae-delete_snapshot" released by "delete_snapshot" :: held 1.471s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-e007c94c-5410-4f38-913d-4188bc4f7567-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-e007c94c-5410-4f38-913d-4188bc4f7567-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-e007c94c-5410-4f38-913d-4188bc4f7567" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-e007c94c-5410-4f38-913d-4188bc4f7567" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9c4d83-c3e9-47cb-ab54-5fe84a64ca2f]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:56 devstack sudo[108575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 Sep 09 17:05:56 devstack sudo[108575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:56 devstack sudo[108575]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567" returned: 0 in 0.343s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:56 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567 Sep 09 17:05:56 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:56 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-e007c94c-5410-4f38-913d-4188bc4f7567" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-e007c94c-5410-4f38-913d-4188bc4f7567" released by "delete_volume" :: held 0.626s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Created reservations ['4b160597-8954-4578-affa-7e80df8de0eb', '46dc61e4-95f0-42ef-92c5-ae1ee08c307f', '963da143-66c9-4ffc-baaf-8890bb956953', '6df69397-0e5c-4cee-aa62-30a9357fc810'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:56 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:56 devstack sudo[108583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:05:56 devstack sudo[108583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:57 devstack sudo[108583]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.233s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:05:57 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Deleted volume successfully. Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1ea2a1c9-dff3-4dc3-8459-08010b9ddf20 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-e007c94c-5410-4f38-913d-4188bc4f7567-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (a3f7fcf5-5e4d-4e5c-8557-073fe9862450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91c7c6a-164c-4362-ae34-08dca5117cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b91c7c6a-164c-4362-ae34-08dca5117cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325219932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8ef9ef-14d6-4f19-9da4-a77ed9411d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:58Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d643a43b-8a37-4dc4-a657-88889f25f5fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d643a43b-8a37-4dc4-a657-88889f25f5fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c94ec97-0f67-44df-815a-13ea8fd4ef74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c94ec97-0f67-44df-815a-13ea8fd4ef74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c8ef9ef-14d6-4f19-9da4-a77ed9411d70', 'volume_name': 'volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df1bd08-dba4-43b1-bf4d-d18f1408f951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df1bd08-dba4-43b1-bf4d-d18f1408f951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b7d18a-4373-4af3-8fd7-525c83b11fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:57 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Volume 4c8ef9ef-14d6-4f19-9da4-a77ed9411d70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70', 'volume_size': 1} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-325219932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c8ef9ef-14d6-4f19-9da4-a77ed9411d70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd94118fc9d45ed9a673f6625b544f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:05:58Z,use_quota=True,user_id='03a71a7d730941b3b982b17ea9b52fea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Creating volume 4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:05:57 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:05:57 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:57 devstack sudo[108587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 1073741824 Sep 09 17:05:57 devstack sudo[108587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:58 devstack sudo[108587]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 1073741824" returned: 0 in 0.378s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:58 devstack sudo[108592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 Sep 09 17:05:58 devstack sudo[108592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:58 devstack sudo[108592]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" returned: 0 in 0.231s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] <== create_volume: return (652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.654s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b7d18a-4373-4af3-8fd7-525c83b11fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f96a204-fc16-4229-acab-69f5036936c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:05:58 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Volume volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 (4c8ef9ef-14d6-4f19-9da4-a77ed9411d70): created successfully Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f96a204-fc16-4229-acab-69f5036936c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Flow 'volume_create_manager' (a3f7fcf5-5e4d-4e5c-8557-073fe9862450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:05:58 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-ad51ad75-cddc-40e8-a37d-4ebb9715f52f tempest-ProjectMemberTests-1056521081 None] Created volume successfully. Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Creating offline snapshot bf910ed2-f9fc-4d85-bb87-a98ee045b15b of volume 4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c31bfa6-0c2f-42a0-9f9a-7de05a5364bf]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:05:58 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:58 devstack sudo[108595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 Sep 09 17:05:58 devstack sudo[108595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:59 devstack sudo[108595]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:59 devstack sudo[108601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b 1G Sep 09 17:05:59 devstack sudo[108601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:59 devstack sudo[108601]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b 1G" returned: 0 in 0.373s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:59 devstack sudo[108606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b Sep 09 17:05:59 devstack sudo[108606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:05:59 devstack sudo[108606]: pam_unix(sudo:session): session closed for user root Sep 09 17:05:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b" returned: 0 in 0.271s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:05:59 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b is being set with open permissions: ugo+rw Sep 09 17:05:59 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:05:59 devstack sudo[108612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b Sep 09 17:05:59 devstack sudo[108612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:00 devstack sudo[108612]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b" returned: 0 in 0.229s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:00 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.info Sep 09 17:06:00 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:00 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.info" returned: 0 in 0.236s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:00 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.info is being set with open permissions: ugo+rw Sep 09 17:06:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:00 devstack sudo[108619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.info Sep 09 17:06:00 devstack sudo[108619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:00 devstack sudo[108619]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.info" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:00 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.754s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:00 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4dea2235-12d4-4e8b-82d7-67308fc80c41 tempest-ProjectMemberTests-1056521081 None] Create snapshot completed successfully Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-bf910ed2-f9fc-4d85-bb87-a98ee045b15b-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Lock "cinder-bf910ed2-f9fc-4d85-bb87-a98ee045b15b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-bf910ed2-f9fc-4d85-bb87-a98ee045b15b" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-bf910ed2-f9fc-4d85-bb87-a98ee045b15b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Deleting offline snapshot bf910ed2-f9fc-4d85-bb87-a98ee045b15b of volume 4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] snapshot_file for this snap is: volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa8ea33-313a-4ac7-81e5-63f2c7892a45]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:01 devstack sudo[108622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b Sep 09 17:06:01 devstack sudo[108622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:01 devstack sudo[108622]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b" returned: 0 in 0.334s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe8170-b3fb-4f6a-bcd2-9c947635f444]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:01 devstack sudo[108627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 Sep 09 17:06:01 devstack sudo[108627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:01 devstack sudo[108627]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:01 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:01 devstack sudo[108632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b Sep 09 17:06:01 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:02 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b" returned: 0 in 0.316s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:02 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b Sep 09 17:06:02 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:02 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:02 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70.bf910ed2-f9fc-4d85-bb87-a98ee045b15b" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-bf910ed2-f9fc-4d85-bb87-a98ee045b15b" released by "_delete_snapshot" :: held 1.312s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" released by "delete_snapshot" :: held 1.334s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:02 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Created reservations ['6da869e3-b745-4597-af01-15188f0b0517', 'e2160ef9-807b-42a5-af63-dd2f825c7f00', '422e4d73-009b-4552-9d2b-2b0ec455760f', '33fe896f-6388-4f35-84ab-69dd3f495d95'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:02 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Delete snapshot completed successfully. Sep 09 17:06:02 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-31ae0bc5-fd99-434d-865c-0df2a01305fb tempest-ProjectMemberTests-1056521081 None] Lock "cinder-bf910ed2-f9fc-4d85-bb87-a98ee045b15b-delete_snapshot" released by "delete_snapshot" :: held 1.467s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "cinder-quobyte-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c27d4b-90fb-4a45-8198-cd3e852a4959]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:03 devstack sudo[108640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 Sep 09 17:06:03 devstack sudo[108640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:03 devstack sudo[108640]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:03 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70 Sep 09 17:06:03 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:03 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-quobyte-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70" released by "delete_volume" :: held 0.640s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:03 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Created reservations ['cca738ed-24fe-4c15-b751-9978814034b2', 'dbe64a32-3c97-416c-aa37-477c1b477fb0', '587148e1-57cf-425b-834d-f23fedd3ad9f', '122a45a5-e7c5-4e45-b32d-cdcf7ccef409'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:04 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:04 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:06:04 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:04 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:04 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:04 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:06:04 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Deleted volume successfully. Sep 09 17:06:04 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-1b9ad32b-750d-4a1f-a957-4012c70da129 tempest-ProjectMemberTests-1056521081 None] Lock "cinder-4c8ef9ef-14d6-4f19-9da4-a77ed9411d70-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=191,cinder:SELECT=151,cinder:INSERT=55,cinder:DELETE=18 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:UPDATE=211,cinder:DELETE=15,cinder:INSERT=53,cinder:SELECT=150 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Flow 'volume_create_manager' (0550dbe4-183d-4527-a197-e4307eb6f017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d414735-c5e6-4ba6-9e7d-bfeb42245e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d414735-c5e6-4ba6-9e7d-bfeb42245e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1606717606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b1cf9c6754f9b977f578a0f30e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:06:08Z,use_quota=True,user_id='26c586f720c449868e0987a3ca008c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9ba192-7702-40bf-ba14-48397657de05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c9ba192-7702-40bf-ba14-48397657de05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190ae348-7bac-45ad-a659-b7f09aa0e5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (190ae348-7bac-45ad-a659-b7f09aa0e5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e', 'volume_name': 'volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfd112c-99ff-4894-86c6-8223e3fe34f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adfd112c-99ff-4894-86c6-8223e3fe34f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094b05cc-5710-4c03-8bf9-0487b2279a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:07 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Volume 4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e', 'volume_size': 1} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1606717606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b1cf9c6754f9b977f578a0f30e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:06:08Z,use_quota=True,user_id='26c586f720c449868e0987a3ca008c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Creating volume 4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:06:07 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:06:07 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:07 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e 1073741824 Sep 09 17:06:07 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:08 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e 1073741824" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:08 devstack sudo[108658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e Sep 09 17:06:08 devstack sudo[108658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:08 devstack sudo[108658]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094b05cc-5710-4c03-8bf9-0487b2279a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909cd353-4824-42d0-8e87-20fff8d8844a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:08 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Volume volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e (4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e): created successfully Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (909cd353-4824-42d0-8e87-20fff8d8844a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Flow 'volume_create_manager' (0550dbe4-183d-4527-a197-e4307eb6f017) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:06:08 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-452835cc-0ada-4bfc-92b4-fe380fdb8f15 tempest-ProjectReaderTests-918919788 None] Created volume successfully. Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Creating offline snapshot 1b3ed9c6-8645-449b-b141-f1f3c077f367 of volume 4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ed69a8-8746-4af1-b193-e62c8fe321f3]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:08 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:08 devstack sudo[108661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e Sep 09 17:06:08 devstack sudo[108661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:09 devstack sudo[108661]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:09 devstack sudo[108666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 1G Sep 09 17:06:09 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:09 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 1G" returned: 0 in 0.364s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:09 devstack sudo[108671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 Sep 09 17:06:09 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:09 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367" returned: 0 in 0.288s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:09 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 is being set with open permissions: ugo+rw Sep 09 17:06:09 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:09 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 Sep 09 17:06:09 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:10 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:10 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.info Sep 09 17:06:10 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:10 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.info" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:10 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.info is being set with open permissions: ugo+rw Sep 09 17:06:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:10 devstack sudo[108682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.info Sep 09 17:06:10 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:10 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.info" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:10 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.787s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:10 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-651e5a3a-2e3f-4e49-8ddb-e3c6736e3ad4 tempest-ProjectReaderTests-918919788 None] Create snapshot completed successfully Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-1b3ed9c6-8645-449b-b141-f1f3c077f367-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Lock "cinder-1b3ed9c6-8645-449b-b141-f1f3c077f367-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-1b3ed9c6-8645-449b-b141-f1f3c077f367" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-1b3ed9c6-8645-449b-b141-f1f3c077f367" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Deleting offline snapshot 1b3ed9c6-8645-449b-b141-f1f3c077f367 of volume 4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] snapshot_file for this snap is: volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde7b71a-1d03-4d15-aa83-c0d29c0c2ccb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:11 devstack sudo[108685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 Sep 09 17:06:11 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:11 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367" returned: 0 in 0.340s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[7902cb78-fe82-4108-9776-dfd5f8e0ae60]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:11 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e Sep 09 17:06:11 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:11 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:11 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:11 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 Sep 09 17:06:11 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:12 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:12 devstack sudo[108700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367 Sep 09 17:06:12 devstack sudo[108700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:12 devstack sudo[108700]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:12 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e.1b3ed9c6-8645-449b-b141-f1f3c077f367" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-1b3ed9c6-8645-449b-b141-f1f3c077f367" released by "_delete_snapshot" :: held 1.334s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" released by "delete_snapshot" :: held 1.354s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:12 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Created reservations ['ab7540bc-eed2-4a1d-87f8-e04d955a3939', 'a53f96c4-8b1e-47ee-82a8-aff0c21c2b06', 'db03b944-eb58-43fb-a58a-54e37385a825', '09863900-0540-4cef-b044-02768199e956'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:12 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Delete snapshot completed successfully. Sep 09 17:06:12 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-6dcdc340-925f-4422-a596-bec819bd3354 tempest-ProjectReaderTests-918919788 None] Lock "cinder-1b3ed9c6-8645-449b-b141-f1f3c077f367-delete_snapshot" released by "delete_snapshot" :: held 1.477s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Lock "cinder-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" acquired by "delete_volume" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff439659-17c7-4aca-afe8-768ec9e8c617]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:13 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e Sep 09 17:06:13 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:13 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:13 devstack sudo[108708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e Sep 09 17:06:13 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:13 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e" released by "delete_volume" :: held 0.638s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Created reservations ['7789454d-88e6-4edf-81de-48ae2124c682', '2501e15f-a2b5-4b9d-9e5c-4897c80465eb', 'a6ce1ee3-d677-430c-9640-6c8955ae5cdb', 'd5211e51-17e4-4190-9a54-75d255bb8da2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:13 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:14 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:06:14 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:14 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:06:14 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Deleted volume successfully. Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9f33ab5f-3bf5-48c2-8d28-6514b0a59b9c tempest-ProjectReaderTests-918919788 None] Lock "cinder-4f697a0b-9ac6-4a4b-b8b6-70cc3cc80e4e-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Flow 'volume_create_manager' (75f2d262-3753-4e58-b29e-cb4b2e786c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd289f72-60e7-4e8f-b532-265cd8e75c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd289f72-60e7-4e8f-b532-265cd8e75c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127989978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59179956-8d82-4ab4-8a75-90803ca91740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b1cf9c6754f9b977f578a0f30e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:06:15Z,use_quota=True,user_id='26c586f720c449868e0987a3ca008c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a674d2d-7b46-4f69-b1ec-de444cc7e9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a674d2d-7b46-4f69-b1ec-de444cc7e9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4af3af-8aee-4ca1-a7aa-e16f6df516b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f4af3af-8aee-4ca1-a7aa-e16f6df516b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59179956-8d82-4ab4-8a75-90803ca91740', 'volume_name': 'volume-59179956-8d82-4ab4-8a75-90803ca91740', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2067dded-5589-4145-9965-c3052a08e270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2067dded-5589-4145-9965-c3052a08e270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39764cd-95dd-4cdc-8a8a-bea2c1b19578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:14 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Volume 59179956-8d82-4ab4-8a75-90803ca91740: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59179956-8d82-4ab4-8a75-90803ca91740', 'volume_size': 1} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:06:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2127989978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59179956-8d82-4ab4-8a75-90803ca91740,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b1cf9c6754f9b977f578a0f30e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:06:15Z,use_quota=True,user_id='26c586f720c449868e0987a3ca008c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Creating volume 59179956-8d82-4ab4-8a75-90803ca91740 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:06:14 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:06:14 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:14 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 1073741824 Sep 09 17:06:14 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:15 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 1073741824" returned: 0 in 0.385s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:15 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 Sep 09 17:06:15 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:15 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] <== create_volume: return (659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.661s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39764cd-95dd-4cdc-8a8a-bea2c1b19578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59179956-8d82-4ab4-8a75-90803ca91740', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e97b33-5c67-404d-853c-099bff96fa97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:15 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Volume volume-59179956-8d82-4ab4-8a75-90803ca91740 (59179956-8d82-4ab4-8a75-90803ca91740): created successfully Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11e97b33-5c67-404d-853c-099bff96fa97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Flow 'volume_create_manager' (75f2d262-3753-4e58-b29e-cb4b2e786c00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:06:15 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-edde92e7-9b37-4d99-abcd-144ce05939a4 tempest-ProjectReaderTests-918919788 None] Created volume successfully. Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Creating offline snapshot 063c27c4-e8dd-40ac-84be-ec0d93e04d94 of volume 59179956-8d82-4ab4-8a75-90803ca91740 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d48ae9-ce81-4ca2-b6c0-7a3620402e43]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:15 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:16 devstack sudo[108723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 Sep 09 17:06:16 devstack sudo[108723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:16 devstack sudo[108723]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740" returned: 0 in 0.335s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:16 devstack sudo[108728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 1G Sep 09 17:06:16 devstack sudo[108728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:16 devstack sudo[108728]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 1G" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59179956-8d82-4ab4-8a75-90803ca91740 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:16 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59179956-8d82-4ab4-8a75-90803ca91740 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 Sep 09 17:06:16 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:16 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59179956-8d82-4ab4-8a75-90803ca91740 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94" returned: 0 in 0.277s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:16 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 is being set with open permissions: ugo+rw Sep 09 17:06:16 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:16 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 Sep 09 17:06:16 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:17 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:17 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.info Sep 09 17:06:17 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:17 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.info" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:17 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.info is being set with open permissions: ugo+rw Sep 09 17:06:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:17 devstack sudo[108745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.info Sep 09 17:06:17 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:17 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.info" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:17 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.778s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:17 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-614e32ca-67a6-4144-97f0-6861b1aac6c9 tempest-ProjectReaderTests-918919788 None] Create snapshot completed successfully Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-063c27c4-e8dd-40ac-84be-ec0d93e04d94-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Lock "cinder-063c27c4-e8dd-40ac-84be-ec0d93e04d94-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-59179956-8d82-4ab4-8a75-90803ca91740" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-59179956-8d82-4ab4-8a75-90803ca91740" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-063c27c4-e8dd-40ac-84be-ec0d93e04d94" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-063c27c4-e8dd-40ac-84be-ec0d93e04d94" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Deleting offline snapshot 063c27c4-e8dd-40ac-84be-ec0d93e04d94 of volume 59179956-8d82-4ab4-8a75-90803ca91740 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] snapshot_file for this snap is: volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[767b0cb5-c964-4aa7-8da1-53178c933664]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:18 devstack sudo[108748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 Sep 09 17:06:18 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:18 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59179956-8d82-4ab4-8a75-90803ca91740(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[85764ecc-0da9-4363-9c34-f46df2ac2626]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:18 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 Sep 09 17:06:18 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:18 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740" returned: 0 in 0.346s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:18 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:18 devstack sudo[108758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 Sep 09 17:06:18 devstack sudo[108758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:19 devstack sudo[108758]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94" returned: 0 in 0.329s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:19 devstack sudo[108763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94 Sep 09 17:06:19 devstack sudo[108763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:19 devstack sudo[108763]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:19 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740.063c27c4-e8dd-40ac-84be-ec0d93e04d94" returned: 0 in 0.242s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-063c27c4-e8dd-40ac-84be-ec0d93e04d94" released by "_delete_snapshot" :: held 1.343s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-59179956-8d82-4ab4-8a75-90803ca91740" released by "delete_snapshot" :: held 1.363s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:19 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Created reservations ['a0d602b7-b1c5-4d9f-9a5a-470c0b3efb53', '17e6383a-6437-466f-b13f-0372997510a7', '1760d79e-729f-4b08-a432-cb966d3d90c6', '3874e761-f91c-4d02-8825-340c05631937'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:19 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Delete snapshot completed successfully. Sep 09 17:06:19 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-fe8479dd-b107-4bd1-81f3-5d10aa2f8961 tempest-ProjectReaderTests-918919788 None] Lock "cinder-063c27c4-e8dd-40ac-84be-ec0d93e04d94-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-59179956-8d82-4ab4-8a75-90803ca91740-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Lock "cinder-59179956-8d82-4ab4-8a75-90803ca91740-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-59179956-8d82-4ab4-8a75-90803ca91740" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-59179956-8d82-4ab4-8a75-90803ca91740" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe2524d-b047-43f7-ab89-05176a368cf4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:20 devstack sudo[108766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 Sep 09 17:06:20 devstack sudo[108766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:20 devstack sudo[108766]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:20 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740 Sep 09 17:06:20 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:20 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-59179956-8d82-4ab4-8a75-90803ca91740" returned: 0 in 0.227s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-59179956-8d82-4ab4-8a75-90803ca91740" released by "delete_volume" :: held 0.624s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Created reservations ['47696637-798b-4645-bb18-ead326bfad35', '4c055339-300c-43e3-91fd-d53e8bd0c584', '9f20b9c0-6d84-40c2-909e-9dbf0555c492', '50ce041a-1227-4200-9ac3-f07ee6205906'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:20 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:06:20 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:21 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:06:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Deleted volume successfully. Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-582f8ab0-b920-4de8-9516-6b1860b09f82 tempest-ProjectReaderTests-918919788 None] Lock "cinder-59179956-8d82-4ab4-8a75-90803ca91740-delete_volume" released by "delete_volume" :: held 1.050s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Flow 'volume_create_manager' (4ffbf520-36c4-4f07-baea-0ecc8520d45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244aa68d-e00d-43f9-ae6e-e72cd1cc1594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244aa68d-e00d-43f9-ae6e-e72cd1cc1594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522816308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7252386e-cc9f-4609-af44-acb71e893339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b1cf9c6754f9b977f578a0f30e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:06:22Z,use_quota=True,user_id='26c586f720c449868e0987a3ca008c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22da2be-0443-41bb-8413-b36c74dccf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22da2be-0443-41bb-8413-b36c74dccf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24df98e1-059b-406f-8a46-66474461da3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24df98e1-059b-406f-8a46-66474461da3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7252386e-cc9f-4609-af44-acb71e893339', 'volume_name': 'volume-7252386e-cc9f-4609-af44-acb71e893339', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe2a04a-de13-4ede-bdde-e048d5ad481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fe2a04a-de13-4ede-bdde-e048d5ad481c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a259d4-c5fc-4c69-963f-1e9f7a51eb69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Volume 7252386e-cc9f-4609-af44-acb71e893339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7252386e-cc9f-4609-af44-acb71e893339', 'volume_size': 1} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:06:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522816308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7252386e-cc9f-4609-af44-acb71e893339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b1cf9c6754f9b977f578a0f30e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:06:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:06:22Z,use_quota=True,user_id='26c586f720c449868e0987a3ca008c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Creating volume 7252386e-cc9f-4609-af44-acb71e893339 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:06:21 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:06:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:21 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 1073741824 Sep 09 17:06:21 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:22 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 1073741824" returned: 0 in 0.389s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:22 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 Sep 09 17:06:22 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:22 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a259d4-c5fc-4c69-963f-1e9f7a51eb69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7252386e-cc9f-4609-af44-acb71e893339', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50da4261-1ae6-4ef4-9e70-e1aab938f4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:22 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Volume volume-7252386e-cc9f-4609-af44-acb71e893339 (7252386e-cc9f-4609-af44-acb71e893339): created successfully Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50da4261-1ae6-4ef4-9e70-e1aab938f4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Flow 'volume_create_manager' (4ffbf520-36c4-4f07-baea-0ecc8520d45a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:06:22 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5527d293-77d2-4bb0-97f2-d0891b6eccce tempest-ProjectReaderTests-918919788 None] Created volume successfully. Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Creating offline snapshot 3fa9ae05-e9ba-4eec-b454-3df9d5cac409 of volume 7252386e-cc9f-4609-af44-acb71e893339 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[501b64ff-23d2-4ceb-b35f-89d7de4ff3ac]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:23 devstack sudo[108785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 Sep 09 17:06:23 devstack sudo[108785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:23 devstack sudo[108785]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:23 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 1G Sep 09 17:06:23 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:23 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 1G" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7252386e-cc9f-4609-af44-acb71e893339 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:23 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7252386e-cc9f-4609-af44-acb71e893339 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 Sep 09 17:06:23 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:23 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7252386e-cc9f-4609-af44-acb71e893339 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409" returned: 0 in 0.287s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:23 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 is being set with open permissions: ugo+rw Sep 09 17:06:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:23 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 Sep 09 17:06:23 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:24 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:24 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.info Sep 09 17:06:24 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:24 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.info" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:24 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.info is being set with open permissions: ugo+rw Sep 09 17:06:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:24 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.info Sep 09 17:06:24 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:24 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.info" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:24 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-8771be48-1ad4-4cef-bdb4-e0465bff42ab tempest-ProjectReaderTests-918919788 None] Create snapshot completed successfully Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-3fa9ae05-e9ba-4eec-b454-3df9d5cac409-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Lock "cinder-3fa9ae05-e9ba-4eec-b454-3df9d5cac409-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-7252386e-cc9f-4609-af44-acb71e893339" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-7252386e-cc9f-4609-af44-acb71e893339" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-3fa9ae05-e9ba-4eec-b454-3df9d5cac409" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-3fa9ae05-e9ba-4eec-b454-3df9d5cac409" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Deleting offline snapshot 3fa9ae05-e9ba-4eec-b454-3df9d5cac409 of volume 7252386e-cc9f-4609-af44-acb71e893339 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] snapshot_file for this snap is: volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd66465d-5de6-49f8-ba63-576cd4a97f8c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:25 devstack sudo[108809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 Sep 09 17:06:25 devstack sudo[108809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:25 devstack sudo[108809]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7252386e-cc9f-4609-af44-acb71e893339(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f11d4b-8435-402d-93b6-bda9d9d2f2ec]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:25 devstack sudo[108814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 Sep 09 17:06:25 devstack sudo[108814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:25 devstack sudo[108814]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339" returned: 0 in 0.358s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:25 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 Sep 09 17:06:25 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:26 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:26 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409 Sep 09 17:06:26 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:26 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:26 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339.3fa9ae05-e9ba-4eec-b454-3df9d5cac409" returned: 0 in 0.231s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-3fa9ae05-e9ba-4eec-b454-3df9d5cac409" released by "_delete_snapshot" :: held 1.327s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-7252386e-cc9f-4609-af44-acb71e893339" released by "delete_snapshot" :: held 1.346s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:26 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Created reservations ['2093b1cb-3d27-4d7b-80d1-2f578f39dced', 'b3153989-e011-46fe-80ae-374be2d50591', '81f2eb25-79e6-4ff5-8d68-eedc96bc7060', 'f8d22f23-1f67-4800-90c0-88a2d80af243'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:26 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Delete snapshot completed successfully. Sep 09 17:06:26 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-cc674db5-6f93-4c69-b078-64dc064caacd tempest-ProjectReaderTests-918919788 None] Lock "cinder-3fa9ae05-e9ba-4eec-b454-3df9d5cac409-delete_snapshot" released by "delete_snapshot" :: held 1.468s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-7252386e-cc9f-4609-af44-acb71e893339-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Lock "cinder-7252386e-cc9f-4609-af44-acb71e893339-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-7252386e-cc9f-4609-af44-acb71e893339" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-7252386e-cc9f-4609-af44-acb71e893339" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4181e473-cd85-4362-941c-b7e752ad1f83]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:27 devstack sudo[108829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 Sep 09 17:06:27 devstack sudo[108829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:27 devstack sudo[108829]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339" returned: 0 in 0.357s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:27 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339 Sep 09 17:06:27 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:27 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7252386e-cc9f-4609-af44-acb71e893339" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-7252386e-cc9f-4609-af44-acb71e893339" released by "delete_volume" :: held 0.648s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Created reservations ['54bf576f-583b-4c01-835a-625ab5704266', '2c46b97c-7c9e-4f09-9bc5-c5be56b98c9c', 'fd71a33a-fe64-437b-81fd-5b5631ad2ab2', 'fae8704a-2d6d-4348-bf4c-f41b75d24488'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:27 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:28 devstack sudo[108837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:06:28 devstack sudo[108837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:28 devstack sudo[108837]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:06:28 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Deleted volume successfully. Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-af0ad95d-32fa-41c8-9a75-e88b71af87a5 tempest-ProjectReaderTests-918919788 None] Lock "cinder-7252386e-cc9f-4609-af44-acb71e893339-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Flow 'volume_create_manager' (ee4ff0e2-5f43-4686-92db-e2bea1ead815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f62f866-f264-431e-b424-4f4e3e9a7c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f62f866-f264-431e-b424-4f4e3e9a7c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361915289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e23291d-27b7-40bf-8502-c7736a583316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b1cf9c6754f9b977f578a0f30e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:06:29Z,use_quota=True,user_id='26c586f720c449868e0987a3ca008c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557d2e4a-fdd1-4b7e-a05d-524b74c40286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557d2e4a-fdd1-4b7e-a05d-524b74c40286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6837e4-c74b-4ef9-b50b-fdc547d9c3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6837e4-c74b-4ef9-b50b-fdc547d9c3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e23291d-27b7-40bf-8502-c7736a583316', 'volume_name': 'volume-7e23291d-27b7-40bf-8502-c7736a583316', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbf43ce-3796-4c49-b2ba-a7e12dd0a7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bbf43ce-3796-4c49-b2ba-a7e12dd0a7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86be2f26-e51f-4d7a-8bc4-06d9de82fafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:28 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Volume 7e23291d-27b7-40bf-8502-c7736a583316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e23291d-27b7-40bf-8502-c7736a583316', 'volume_size': 1} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1361915289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e23291d-27b7-40bf-8502-c7736a583316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b1cf9c6754f9b977f578a0f30e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:06:29Z,use_quota=True,user_id='26c586f720c449868e0987a3ca008c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Creating volume 7e23291d-27b7-40bf-8502-c7736a583316 {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:06:28 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:06:28 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:28 devstack sudo[108841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 1073741824 Sep 09 17:06:28 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:29 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 1073741824" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:29 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 Sep 09 17:06:29 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:29 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86be2f26-e51f-4d7a-8bc4-06d9de82fafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e23291d-27b7-40bf-8502-c7736a583316', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d4025f-6877-4c1c-9e8f-f8e033a26eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Volume volume-7e23291d-27b7-40bf-8502-c7736a583316 (7e23291d-27b7-40bf-8502-c7736a583316): created successfully Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4d4025f-6877-4c1c-9e8f-f8e033a26eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Flow 'volume_create_manager' (ee4ff0e2-5f43-4686-92db-e2bea1ead815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:06:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-0fb736fc-8660-45cf-95cf-d89e5f75ba21 tempest-ProjectReaderTests-918919788 None] Created volume successfully. Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Creating offline snapshot 197442bb-e388-4178-ab37-47f537aeae36 of volume 7e23291d-27b7-40bf-8502-c7736a583316 {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[222e4653-f5fc-4888-bb9f-5555c52a928d]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:30 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 Sep 09 17:06:30 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:30 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316" returned: 0 in 0.355s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:30 devstack sudo[108854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 1G Sep 09 17:06:30 devstack sudo[108854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:30 devstack sudo[108854]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 1G" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e23291d-27b7-40bf-8502-c7736a583316 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:30 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e23291d-27b7-40bf-8502-c7736a583316 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 Sep 09 17:06:30 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:30 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7e23291d-27b7-40bf-8502-c7736a583316 -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36" returned: 0 in 0.280s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:30 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 is being set with open permissions: ugo+rw Sep 09 17:06:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:30 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 Sep 09 17:06:30 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:31 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36" returned: 0 in 0.246s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:31 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.info Sep 09 17:06:31 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:31 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.info" returned: 0 in 0.256s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:31 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.info is being set with open permissions: ugo+rw Sep 09 17:06:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:31 devstack sudo[108907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.info Sep 09 17:06:31 devstack sudo[108907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:31 devstack sudo[108907]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.info" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.836s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5a36db9d-3d64-4de6-a82a-e7690b48eb18 tempest-ProjectReaderTests-918919788 None] Create snapshot completed successfully Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-197442bb-e388-4178-ab37-47f537aeae36-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Lock "cinder-197442bb-e388-4178-ab37-47f537aeae36-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-7e23291d-27b7-40bf-8502-c7736a583316" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-7e23291d-27b7-40bf-8502-c7736a583316" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-197442bb-e388-4178-ab37-47f537aeae36" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-197442bb-e388-4178-ab37-47f537aeae36" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Deleting offline snapshot 197442bb-e388-4178-ab37-47f537aeae36 of volume 7e23291d-27b7-40bf-8502-c7736a583316 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] snapshot_file for this snap is: volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[3924d6c6-c182-452b-9ccf-450495cbc6cb]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:32 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 Sep 09 17:06:32 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:32 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7e23291d-27b7-40bf-8502-c7736a583316(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3da096-2266-4e1a-9bc5-6ae2b89d0c9c]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:32 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 Sep 09 17:06:32 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:32 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316" returned: 0 in 0.345s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:32 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 Sep 09 17:06:32 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:33 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36" returned: 0 in 0.317s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:33 devstack sudo[108926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36 Sep 09 17:06:33 devstack sudo[108926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:33 devstack sudo[108926]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316.197442bb-e388-4178-ab37-47f537aeae36" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-197442bb-e388-4178-ab37-47f537aeae36" released by "_delete_snapshot" :: held 1.329s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-7e23291d-27b7-40bf-8502-c7736a583316" released by "delete_snapshot" :: held 1.352s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:33 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Created reservations ['86feafc5-7f39-4ced-a4f3-c671dcf60804', 'd6c4ca7c-0d56-4fee-b503-f5d3c60f8b02', 'dcc1a15d-6e00-4ae3-9f0b-b8fe765c323e', 'e3bdfe07-1f40-4a5e-b8ce-b9fe5f8cacc8'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Delete snapshot completed successfully. Sep 09 17:06:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-9885f5d8-3545-4bb4-b0ed-ce9a86e7bba1 tempest-ProjectReaderTests-918919788 None] Lock "cinder-197442bb-e388-4178-ab37-47f537aeae36-delete_snapshot" released by "delete_snapshot" :: held 1.485s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-7e23291d-27b7-40bf-8502-c7736a583316-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Lock "cinder-7e23291d-27b7-40bf-8502-c7736a583316-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-7e23291d-27b7-40bf-8502-c7736a583316" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-7e23291d-27b7-40bf-8502-c7736a583316" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b3d7b7-e7b9-4281-bd70-e31db4692500]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:34 devstack sudo[108929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 Sep 09 17:06:34 devstack sudo[108929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:34 devstack sudo[108929]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316" returned: 0 in 0.369s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:34 devstack sudo[108934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316 Sep 09 17:06:34 devstack sudo[108934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:34 devstack sudo[108934]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-7e23291d-27b7-40bf-8502-c7736a583316" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-7e23291d-27b7-40bf-8502-c7736a583316" released by "delete_volume" :: held 0.661s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Created reservations ['cc895e4b-4062-4e1c-a011-1525e5155008', '21e537a6-dbc1-4ef4-91ee-552b24a4d7c4', '9cc60e7c-69bf-4299-b8ae-7cc977a7c548', '31b621c7-f73a-47bb-9656-e684fc0f2881'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:35 devstack sudo[108937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:06:35 devstack sudo[108937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:35 devstack sudo[108937]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.245s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:06:35 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Deleted volume successfully. Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-62fc4a38-d8ef-4d3f-9e3a-4d2f35c70236 tempest-ProjectReaderTests-918919788 None] Lock "cinder-7e23291d-27b7-40bf-8502-c7736a583316-delete_volume" released by "delete_volume" :: held 1.088s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Flow 'volume_create_manager' (c76395e9-e802-4b40-841b-ba60afa46c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7743be09-1f95-437b-bbbd-46318e61dddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7743be09-1f95-437b-bbbd-46318e61dddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673484978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e05042-fca3-478f-88c2-cda9f392d61d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b1cf9c6754f9b977f578a0f30e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:06:36Z,use_quota=True,user_id='26c586f720c449868e0987a3ca008c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76044e6c-8b18-47d2-ade8-575d352be754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76044e6c-8b18-47d2-ade8-575d352be754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19372029-e2c5-4e97-8ee9-6495b89bd446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19372029-e2c5-4e97-8ee9-6495b89bd446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2e05042-fca3-478f-88c2-cda9f392d61d', 'volume_name': 'volume-f2e05042-fca3-478f-88c2-cda9f392d61d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d46eb0a-ea59-40b9-991d-b8233ef853a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d46eb0a-ea59-40b9-991d-b8233ef853a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a53714f-d5b2-4ba0-8150-073ea9aa8e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:35 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Volume f2e05042-fca3-478f-88c2-cda9f392d61d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2e05042-fca3-478f-88c2-cda9f392d61d', 'volume_size': 1} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1673484978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2e05042-fca3-478f-88c2-cda9f392d61d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='616b1cf9c6754f9b977f578a0f30e133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:06:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:06:36Z,use_quota=True,user_id='26c586f720c449868e0987a3ca008c40',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Creating volume f2e05042-fca3-478f-88c2-cda9f392d61d {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:06:35 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:06:35 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:35 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d 1073741824 Sep 09 17:06:35 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:36 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d 1073741824" returned: 0 in 0.404s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:36 devstack sudo[108947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d Sep 09 17:06:36 devstack sudo[108947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:36 devstack sudo[108947]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a53714f-d5b2-4ba0-8150-073ea9aa8e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2e05042-fca3-478f-88c2-cda9f392d61d', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6ec2d0-b296-448c-92cf-5146176aa94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:06:36 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Volume volume-f2e05042-fca3-478f-88c2-cda9f392d61d (f2e05042-fca3-478f-88c2-cda9f392d61d): created successfully Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6ec2d0-b296-448c-92cf-5146176aa94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Flow 'volume_create_manager' (c76395e9-e802-4b40-841b-ba60afa46c1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:06:36 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-4779dced-ab59-4c0d-929b-0c6d08b09884 tempest-ProjectReaderTests-918919788 None] Created volume successfully. Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Creating offline snapshot a6a1aac4-b05e-409c-9ebd-1951756a7f54 of volume f2e05042-fca3-478f-88c2-cda9f392d61d {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af04c24-5b5b-41ec-b2c1-520ac7772d09]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:36 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:37 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d Sep 09 17:06:37 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:37 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d" returned: 0 in 0.370s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:37 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 1G Sep 09 17:06:37 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:37 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 1G" returned: 0 in 0.405s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:37 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e05042-fca3-478f-88c2-cda9f392d61d -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:37 devstack sudo[108960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e05042-fca3-478f-88c2-cda9f392d61d -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 Sep 09 17:06:37 devstack sudo[108960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:38 devstack sudo[108960]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2e05042-fca3-478f-88c2-cda9f392d61d -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54" returned: 0 in 0.289s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:38 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 is being set with open permissions: ugo+rw Sep 09 17:06:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:38 devstack sudo[108965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 Sep 09 17:06:38 devstack sudo[108965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:38 devstack sudo[108965]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54" returned: 0 in 0.269s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:38 devstack sudo[108968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.info Sep 09 17:06:38 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:38 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.info" returned: 0 in 0.255s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:38 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.info is being set with open permissions: ugo+rw Sep 09 17:06:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:38 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.info Sep 09 17:06:38 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:38 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.info" returned: 0 in 0.235s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:38 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.895s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:38 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-54880e19-2d31-424f-84b3-3f57b7ce6ae0 tempest-ProjectReaderTests-918919788 None] Create snapshot completed successfully Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-a6a1aac4-b05e-409c-9ebd-1951756a7f54-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Lock "cinder-a6a1aac4-b05e-409c-9ebd-1951756a7f54-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-f2e05042-fca3-478f-88c2-cda9f392d61d" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-f2e05042-fca3-478f-88c2-cda9f392d61d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-a6a1aac4-b05e-409c-9ebd-1951756a7f54" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-a6a1aac4-b05e-409c-9ebd-1951756a7f54" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Deleting offline snapshot a6a1aac4-b05e-409c-9ebd-1951756a7f54 of volume f2e05042-fca3-478f-88c2-cda9f392d61d {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] snapshot_file for this snap is: volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4950bfae-68d1-47e8-818e-5f10e5300830]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:39 devstack sudo[108974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 Sep 09 17:06:39 devstack sudo[108974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:39 devstack sudo[108974]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54" returned: 0 in 0.349s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2e05042-fca3-478f-88c2-cda9f392d61d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[701b76f5-aad9-4214-ad8b-dd2dace9ba28]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:39 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d Sep 09 17:06:39 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:39 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d" returned: 0 in 0.339s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:39 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:39 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 Sep 09 17:06:39 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:40 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54" returned: 0 in 0.321s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:40 devstack sudo[108989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54 Sep 09 17:06:40 devstack sudo[108989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:40 devstack sudo[108989]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:40 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d.a6a1aac4-b05e-409c-9ebd-1951756a7f54" returned: 0 in 0.237s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-a6a1aac4-b05e-409c-9ebd-1951756a7f54" released by "_delete_snapshot" :: held 1.328s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-f2e05042-fca3-478f-88c2-cda9f392d61d" released by "delete_snapshot" :: held 1.350s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:40 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Created reservations ['7e02e3fc-180e-4b3d-bb5d-6206456b3291', 'f13a3f56-7926-4605-bbfc-0d2d6b065969', 'e35f4ea7-ecb8-4662-9d65-dee37986d4a3', '82fca1fa-3b20-499f-82d4-299951c0ba83'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:40 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Delete snapshot completed successfully. Sep 09 17:06:40 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-c8e23191-d9b8-4881-ba7b-29d367de18d4 tempest-ProjectReaderTests-918919788 None] Lock "cinder-a6a1aac4-b05e-409c-9ebd-1951756a7f54-delete_snapshot" released by "delete_snapshot" :: held 1.474s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-f2e05042-fca3-478f-88c2-cda9f392d61d-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Lock "cinder-f2e05042-fca3-478f-88c2-cda9f392d61d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Acquiring lock "cinder-quobyte-f2e05042-fca3-478f-88c2-cda9f392d61d" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-f2e05042-fca3-478f-88c2-cda9f392d61d" acquired by "delete_volume" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee146543-f865-4fc1-a3a1-17da28a8a4ee]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:41 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d Sep 09 17:06:41 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:41 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d" returned: 0 in 0.363s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:41 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d Sep 09 17:06:41 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:41 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-f2e05042-fca3-478f-88c2-cda9f392d61d" returned: 0 in 0.239s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Lock "cinder-quobyte-f2e05042-fca3-478f-88c2-cda9f392d61d" released by "delete_volume" :: held 0.652s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:41 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Created reservations ['9d50611b-3f37-4475-aba2-33a06c9fa3ef', 'f1b9ef84-b724-4154-986c-2352f140decc', 'bee58090-35fb-4d87-873c-83a7cf0595a5', '6cbc013a-a0ca-4dce-8302-879a5f1a03f2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:06:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:42 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:42 devstack sudo[109006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:06:42 devstack sudo[109006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:42 devstack sudo[109006]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:42 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.232s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:42 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:06:42 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Deleted volume successfully. Sep 09 17:06:42 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-f61613b1-a753-48cf-8854-ff9b2dc35e39 tempest-ProjectReaderTests-918919788 None] Lock "cinder-f2e05042-fca3-478f-88c2-cda9f392d61d-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:06:45 devstack sudo[109010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:06:45 devstack sudo[109010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:06:45 devstack sudo[109010]: pam_unix(sudo:session): session closed for user root Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.254s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:06:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 09 17:06:52 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=72,cinder:INSERT=22,cinder:UPDATE=84,cinder:DELETE=7 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:06:52 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=68,cinder:UPDATE=96,cinder:INSERT=28,cinder:DELETE=8 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Flow 'volume_create_manager' (19ec902b-83fb-4cf9-9a75-f11d87cb4365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5a42d3-690b-4840-b826-431287cd5a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5a42d3-690b-4840-b826-431287cd5a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-835621193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f1d919-6c05-4f93-b5f5-50e6a1d517da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fad9e3028a945a4bc74fc936913b1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:07:21Z,use_quota=True,user_id='c3200324942c40bab1eb2f6fa11dee71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a201d10-9081-4de7-9c89-d5a0b0a385da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a201d10-9081-4de7-9c89-d5a0b0a385da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8cae6e-6e36-49b0-b102-4c65fbcea16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c8cae6e-6e36-49b0-b102-4c65fbcea16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16f1d919-6c05-4f93-b5f5-50e6a1d517da', 'volume_name': 'volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63bdf69b-4e33-4b2d-bee4-a0447fb7c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63bdf69b-4e33-4b2d-bee4-a0447fb7c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fbc017-4145-49bc-95da-22ddebf294e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:20 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Volume 16f1d919-6c05-4f93-b5f5-50e6a1d517da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da', 'volume_size': 1} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:07:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-835621193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16f1d919-6c05-4f93-b5f5-50e6a1d517da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fad9e3028a945a4bc74fc936913b1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:07:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:07:21Z,use_quota=True,user_id='c3200324942c40bab1eb2f6fa11dee71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)}" {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1506}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Creating volume 16f1d919-6c05-4f93-b5f5-50e6a1d517da {{(pid=87498) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:07:20 devstack cinder-volume[87498]: INFO cinder.volume.drivers.remotefs [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] casted to osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e Sep 09 17:07:20 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da 1073741824 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:20 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da 1073741824 Sep 09 17:07:20 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:21 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da 1073741824" returned: 0 in 0.422s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:21 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da Sep 09 17:07:21 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:21 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'} {{(pid=87498) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1531}} Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03fbc017-4145-49bc-95da-22ddebf294e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da', 'volume_size': 1}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557d439a-b303-4e3f-971d-1a3927be9ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:21 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Volume volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da (16f1d919-6c05-4f93-b5f5-50e6a1d517da): created successfully Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (557d439a-b303-4e3f-971d-1a3927be9ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Flow 'volume_create_manager' (19ec902b-83fb-4cf9-9a75-f11d87cb4365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:07:21 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-3dca0ef9-182b-4a00-8b08-ea9a5f3ff23d tempest-SnapshotDependencyTests-55467676 None] Created volume successfully. Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Creating offline snapshot 8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 of volume 16f1d919-6c05-4f93-b5f5-50e6a1d517da {{(pid=87498) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a2396e-cf89-42e0-b1d6-55940ab3f081]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:07:21 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:21 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da Sep 09 17:07:21 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:22 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 1G {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:22 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 1G Sep 09 17:07:22 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:22 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 1G" returned: 0 in 0.382s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:22 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 Sep 09 17:07:22 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:22 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da -F qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16" returned: 0 in 0.294s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:22 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 is being set with open permissions: ugo+rw Sep 09 17:07:22 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:22 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 Sep 09 17:07:22 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:23 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:23 devstack sudo[109048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.info Sep 09 17:07:23 devstack sudo[109048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:23 devstack sudo[109048]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.info" returned: 0 in 0.251s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:23 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.info is being set with open permissions: ugo+rw Sep 09 17:07:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.info {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:23 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.info Sep 09 17:07:23 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:23 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.info" returned: 0 in 0.241s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:23 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.858s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:07:23 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-40ef67df-dcc4-4b10-977f-cfa34f6a7130 tempest-SnapshotDependencyTests-55467676 None] Create snapshot completed successfully Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.flows.manager.create_volume [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87498) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Flow 'volume_create_manager' (248bd4c5-315c-4cea-bfba-f0a5f3ae6423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d093489-efe7-4a8b-b1fc-1cb166d696dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d093489-efe7-4a8b-b1fc-1cb166d696dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-09T15:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f90d54b-f2fa-4382-9d46-045b9266dea5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fad9e3028a945a4bc74fc936913b1b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-09T15:07:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8b91d5fd-b202-400e-b9d6-5b1f23d9bb16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-09T15:07:24Z,use_quota=True,user_id='c3200324942c40bab1eb2f6fa11dee71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b78c164a-3fba-48e8-b8d4-c255fcef5345),volume_type_id=b78c164a-3fba-48e8-b8d4-c255fcef5345)' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44eeb612-1925-47b2-b5e5-c76caadbc4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44eeb612-1925-47b2-b5e5-c76caadbc4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd86c3b-012a-46d6-ad65-19f18ea1215b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edd86c3b-012a-46d6-ad65-19f18ea1215b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4f90d54b-f2fa-4382-9d46-045b9266dea5', 'volume_name': 'volume-4f90d54b-f2fa-4382-9d46-045b9266dea5', 'volume_size': 1, 'snapshot_id': '8b91d5fd-b202-400e-b9d6-5b1f23d9bb16'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6b989b-226c-44a0-8b25-7a0b448d2cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a6b989b-226c-44a0-8b25-7a0b448d2cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adba5a23-1c47-4f45-8f08-95907cb3d108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:24 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Volume 4f90d54b-f2fa-4382-9d46-045b9266dea5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4f90d54b-f2fa-4382-9d46-045b9266dea5', 'volume_size': 1, 'snapshot_id': '8b91d5fd-b202-400e-b9d6-5b1f23d9bb16'} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "cinder-quobyte-8b91d5fd-b202-400e-b9d6-5b1f23d9bb16-4f90d54b-f2fa-4382-9d46-045b9266dea5" by "_create_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-8b91d5fd-b202-400e-b9d6-5b1f23d9bb16-4f90d54b-f2fa-4382-9d46-045b9266dea5" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Creating volume 4f90d54b-f2fa-4382-9d46-045b9266dea5 from snapshot 8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 {{(pid=87498) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Selected osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e as target Quobyte volume. {{(pid=87498) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "cinder-quobyte-4f90d54b-f2fa-4382-9d46-045b9266dea5" by "_copy_volume_from_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-4f90d54b-f2fa-4382-9d46-045b9266dea5" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] snapshot: 8b91d5fd-b202-400e-b9d6-5b1f23d9bb16, volume: 4f90d54b-f2fa-4382-9d46-045b9266dea5, {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[418fb31f-2330-430f-8aaa-d6c3a22dca4e]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:24 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 Sep 09 17:07:24 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:24 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16" returned: 0 in 0.359s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb45ac3f-de3e-4c65-a0e4-3f3d9cc32176]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:07:24 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:25 devstack sudo[109060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da Sep 09 17:07:25 devstack sudo[109060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:25 devstack sudo[109060]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da" returned: 0 in 0.356s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] will copy from snapshot at /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 09 17:07:25 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Creating direct copy from snapshot {{(pid=87498) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 09 17:07:25 devstack cinder-volume[87498]: DEBUG cinder.utils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Path /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 not found in is_blk_device check {{(pid=87498) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 09 17:07:25 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:25 devstack sudo[109065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 Sep 09 17:07:25 devstack sudo[109065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:29 devstack sudo[109065]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5" returned: 0 in 4.047s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG cinder.image.image_utils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Image conversion details: src /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 {{(pid=87498) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 09 17:07:29 devstack cinder-volume[87498]: INFO cinder.image.image_utils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Converted 1024.00 MB image at 252.96 MB/s Sep 09 17:07:29 devstack cinder-volume[87498]: WARNING cinder.volume.drivers.remotefs [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 is being set with open permissions: ugo+rw Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:29 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 Sep 09 17:07:29 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:29 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5" returned: 0 in 0.253s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-4f90d54b-f2fa-4382-9d46-045b9266dea5" released by "_copy_volume_from_snapshot" :: held 5.093s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-8b91d5fd-b202-400e-b9d6-5b1f23d9bb16-4f90d54b-f2fa-4382-9d46-045b9266dea5" released by "_create_volume_from_snapshot" :: held 5.158s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.173s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adba5a23-1c47-4f45-8f08-95907cb3d108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f90d54b-f2fa-4382-9d46-045b9266dea5', 'volume_size': 1, 'snapshot_id': '8b91d5fd-b202-400e-b9d6-5b1f23d9bb16'}' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492c56f0-35bd-4bee-a410-06ea534ddb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 09 17:07:29 devstack cinder-volume[87498]: INFO cinder.volume.flows.manager.create_volume [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Volume volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 (4f90d54b-f2fa-4382-9d46-045b9266dea5): created successfully Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492c56f0-35bd-4bee-a410-06ea534ddb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87498) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Flow 'volume_create_manager' (248bd4c5-315c-4cea-bfba-f0a5f3ae6423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87498) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 09 17:07:29 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-006661aa-88e1-4c3e-b77d-fc13160207f0 tempest-SnapshotDependencyTests-55467676 None] Created volume successfully. Sep 09 17:07:29 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "cinder-8b91d5fd-b202-400e-b9d6-5b1f23d9bb16-delete_snapshot" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-8b91d5fd-b202-400e-b9d6-5b1f23d9bb16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "cinder-quobyte-16f1d919-6c05-4f93-b5f5-50e6a1d517da" by "delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-16f1d919-6c05-4f93-b5f5-50e6a1d517da" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "cinder-quobyte-8b91d5fd-b202-400e-b9d6-5b1f23d9bb16" by "_delete_snapshot" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-8b91d5fd-b202-400e-b9d6-5b1f23d9bb16" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Deleting offline snapshot 8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 of volume 16f1d919-6c05-4f93-b5f5-50e6a1d517da {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] snapshot_file for this snap is: volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 {{(pid=87498) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdc2a2e-fa51-4fd2-b3bb-4cb1893bcec4]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:30 devstack sudo[109083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 Sep 09 17:07:30 devstack sudo[109083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:30 devstack sudo[109083]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16" returned: 0 in 0.347s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.remotefs [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87498) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9ea3f0-0cbf-46ff-9950-4243ce55bc18]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:30 devstack sudo[109088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da Sep 09 17:07:30 devstack sudo[109088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:30 devstack sudo[109088]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da" returned: 0 in 0.515s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:30 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:30 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 Sep 09 17:07:30 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:31 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16" returned: 0 in 0.310s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:31 devstack sudo[109099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16 Sep 09 17:07:31 devstack sudo[109099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:31 devstack sudo[109099]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:31 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da.8b91d5fd-b202-400e-b9d6-5b1f23d9bb16" returned: 0 in 0.249s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-8b91d5fd-b202-400e-b9d6-5b1f23d9bb16" released by "_delete_snapshot" :: held 1.513s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:07:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-16f1d919-6c05-4f93-b5f5-50e6a1d517da" released by "delete_snapshot" :: held 1.535s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:07:31 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Created reservations ['a90eed52-3d33-42c6-8cd7-baac951abaf8', 'bc73833e-5056-426c-ae16-8fd63e24614e', '95d5d49d-04f0-4201-8e20-8b0e542b3bcc', '9f9f7408-2ab4-4108-8434-4bf5c3a757c2'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:07:31 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Delete snapshot completed successfully. Sep 09 17:07:31 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-5a347145-5909-4cfc-b49d-5ee86b6ba437 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-8b91d5fd-b202-400e-b9d6-5b1f23d9bb16-delete_snapshot" released by "delete_snapshot" :: held 1.672s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "cinder-16f1d919-6c05-4f93-b5f5-50e6a1d517da-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-16f1d919-6c05-4f93-b5f5-50e6a1d517da-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "cinder-quobyte-16f1d919-6c05-4f93-b5f5-50e6a1d517da" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-16f1d919-6c05-4f93-b5f5-50e6a1d517da" acquired by "delete_volume" :: waited 0.015s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daec2b4-d4c2-4aac-861e-de6ce0e2c9a8]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:32 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da Sep 09 17:07:32 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:32 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da" returned: 0 in 0.348s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:32 devstack sudo[109143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da Sep 09 17:07:32 devstack sudo[109143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:32 devstack sudo[109143]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-16f1d919-6c05-4f93-b5f5-50e6a1d517da" returned: 0 in 0.250s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-16f1d919-6c05-4f93-b5f5-50e6a1d517da" released by "delete_volume" :: held 0.648s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Created reservations ['396c15f7-dbf1-4cbb-881b-e3db1a6b535d', '3a502c14-d4a0-4db4-b99b-00117ded9769', 'fcd2d6e0-c415-48d4-ab77-0cd0e970a66b', '48388273-ea7f-4007-ac1f-4eb243dab54e'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:07:32 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:32 devstack sudo[109146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:07:32 devstack sudo[109146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:33 devstack sudo[109146]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.244s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:07:33 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Deleted volume successfully. Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-73d77470-1ac7-4c47-a3c6-504dea376818 tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-16f1d919-6c05-4f93-b5f5-50e6a1d517da-delete_volume" released by "delete_volume" :: held 1.082s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "cinder-4f90d54b-f2fa-4382-9d46-045b9266dea5-delete_volume" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-4f90d54b-f2fa-4382-9d46-045b9266dea5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "cinder-quobyte-4f90d54b-f2fa-4382-9d46-045b9266dea5" by "delete_volume" {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-4f90d54b-f2fa-4382-9d46-045b9266dea5" acquired by "delete_volume" :: waited 0.017s {{(pid=87498) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc2d255-49cc-4b4b-8e37-0f6c0dd00a09]: (4, 'qcow2') {{(pid=88694) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:33 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 Sep 09 17:07:33 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:33 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5" returned: 0 in 0.351s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:33 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5 Sep 09 17:07:33 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:33 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72/volume-4f90d54b-f2fa-4382-9d46-045b9266dea5" returned: 0 in 0.247s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:33 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-quobyte-4f90d54b-f2fa-4382-9d46-045b9266dea5" released by "delete_volume" :: held 0.637s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:07:34 devstack cinder-volume[87498]: DEBUG cinder.quota [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Created reservations ['f6171301-4a02-4bd1-b6d4-0662fb1ef392', '6a841764-9c4a-4a8c-ba9a-48b82e20e51d', '8bdae8e2-2c2b-4516-bffb-dcf1b0541b29', '9698e52d-5a8b-4720-bc10-43e489798617'] {{(pid=87498) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 09 17:07:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:07:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:07:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:07:34 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:07:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:07:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:34 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:07:34 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:34 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:34 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.238s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:34 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:07:34 devstack cinder-volume[87498]: INFO cinder.volume.manager [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Deleted volume successfully. Sep 09 17:07:34 devstack cinder-volume[87498]: DEBUG cinder.coordination [None req-d8b84bbd-da06-4108-a9a0-4cb907cd35ae tempest-SnapshotDependencyTests-55467676 None] Lock "cinder-4f90d54b-f2fa-4382-9d46-045b9266dea5-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=87498) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 09 17:07:44 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=25,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:07:44 devstack cinder-volume[87498]: DEBUG dbcounter [-] [87498] Writing DB stats cinder:SELECT=24,cinder:INSERT=7,cinder:UPDATE=27,cinder:DELETE=3 {{(pid=87498) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e': None} {{(pid=87498) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG cinder.volume.drivers.quobyte [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-efa113fa-3a6a-40b7-9d3f-5b3b1bf4884e'] {{(pid=87498) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.lockutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87498) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 09 17:07:45 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72 Sep 09 17:07:45 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 09 17:07:45 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG oslo_concurrency.processutils [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/fac66ca605aaa506f8a30be465cffc72" returned: 0 in 0.240s {{(pid=87498) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG cinder.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Notifying Schedulers of capabilities ... {{(pid=87498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG oslo_service.periodic_task [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] Running periodic task VolumeManager._thread_info {{(pid=87498) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread count: 28 {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 09 17:07:45 devstack cinder-volume[87498]: DEBUG cinder.volume.manager [None req-7a84b92f-c550-4eaf-96c5-e765731a01e4 None None] thread info: [<_MainThread(MainThread, started 128975286571136)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87498) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}